00000001:02000400:0.0F:1788571826.034688:0:2952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788571848.055440:0:3175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788571850.266395:0:3218:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 592 MB/s 00000001:01000000:0.0:1788571850.520864:0:3218:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 622 MB/s 00000001:01000000:3.0:1788571850.770410:0:3218:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3631 MB/s 00000020:02000000:2.0F:1788571851.572626:0:3266:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_4_g27fe0b7 00000400:02000000:3.0:1788571852.466146:0:3281:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.102@tcp [8/256/0/180] 00008000:02000000:2.0:1788571856.420168:0:3431:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1788571912.559406:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788571924.099560:0:5811:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788571924.099568:0:5811:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788571924.100973:0:5811:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000008afb825 00000080:02000400:0.0:1788571924.100988:0:5811:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788571924.106090:0:5811:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788571924.106104:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788571924.106145:0:5811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ee20cf8c) 00000020:00000080:0.0:1788571924.106168:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788571924.142945:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788571924.144085:0:5811:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788571924.195580:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788571924.196451:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788571924.196485:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788571924.196541:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788571924.196567:0:5811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788571924.197081:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788571924.197089:0:5811:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788571924.197098:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969bff281 00000020:01000004:3.0:1788571924.197107:0:5811:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788571924.197110:0:5811:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788571924.197114:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000008afb825 from MGS 00000020:01000004:3.0:1788571924.197119:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788571924.197138:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007eb2f460) 00000020:00000080:3.0:1788571924.197149:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788571924.199679:0:5811:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000008afb825 from MGS, refs=2 00080000:01000000:3.0:1788571924.199696:0:5811:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788571924.199709:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969bff28f 00000100:00100000:3.0:1788571924.199847:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788571924.199990:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788571924.199995:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788571924.202402:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788571924.202416:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788571924.203299:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788571924.203491:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788571924.203498:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788571924.204484:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788571924.204493:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788571924.205419:0:5811:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788571924.205428:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788571924.212550:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571924.212556:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571924.212558:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571924.212957:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571924.212960:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571924.212961:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571924.213596:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788571924.216975:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788571924.465582:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2313 MB/s 00000001:01000000:2.0:1788571924.716284:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2051 MB/s 00000001:01000000:0.0:1788571924.966525:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 615 MB/s 00000001:01000000:3.0:1788571925.216875:0:5811:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 551 MB/s 00010000:00010000:2.0:1788571925.225034:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788571925.241516:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788571925.256151:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788571925.256170:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788571925.256173:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788571925.269181:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788571925.269298:0:5811:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788571925.269392:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788571925.269831:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788571925.269863:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788571925.270199:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788571925.270752:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788571925.270759:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788571925.274990:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788571925.275006:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788571925.277401:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788571925.277416:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788571925.278126:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788571925.278147:0:5811:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.102@tcp' 00000020:01000004:1.0:1788571925.278149:0:5811:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788571925.278199:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.102@tcp (typ=mgc) 00000020:00000080:1.0:1788571925.278220:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.102@tcp (000000007423efb0) 00000020:00000080:1.0:1788571925.278238:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788571925.278360:0:5811:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dc09c37d@MGC192.168.202.102@tcp: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1788571925.278524:0:5811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.102@tcp-0 is initialized 00000040:01000000:1.0:1788571925.278531:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788571925.278827:0:5826:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788571925.281741:0:5827:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788571925.281796:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.102@tcp (uuid 07b09b9b-dc48-4957-bfb2-5dac95d9db69) 00000020:00000080:1.0:1788571925.281820:0:5811:0:(genops.c:1385:class_connect()) connect: client 07b09b9b-dc48-4957-bfb2-5dac95d9db69, cookie 0x977d9e7969bff29d 00000100:00080000:1.0:1788571925.281834:0:5811:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788571925.281840:0:5811:0:(import.c:665:import_select_connection()) MGC192.168.202.102@tcp: import 00000000dc09c37d using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788571925.281885:0:5811:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000011ec5b4c x1875453518282880/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788571925.281906:0:5811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS 00000020:01000004:1.0:1788571925.281936:0:5811:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788571925.281942:0:5811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788571925.281955:0:5811:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d0db40ec) 00000020:00000080:1.0:1788571925.281966:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788571925.284983:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011ec5b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3296:1875453518282880:0@lo:250: 00000100:00100000:0.0:1788571925.285101:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571925.285187:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518282880 00000100:00100000:0.0:1788571925.285194:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518282880 00000100:00100000:0.0:1788571925.285221:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788571925.285227:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ffb4b10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3296:x1875453518282880:12345-0@lo:250: 00010000:00080000:0.0:1788571925.285276:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 07b09b9b-dc48-4957-bfb2-5dac95d9db69@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:0.0:1788571925.285321:0:5823:0:(genops.c:1385:class_connect()) connect: client 07b09b9b-dc48-4957-bfb2-5dac95d9db69, cookie 0x977d9e7969bff2ab 00000100:00080000:0.0:1788571925.285472:0:5823:0:(import.c:65:import_set_state_nolock()) 00000000c2358206 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788571925.285523:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ffb4b10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:3296:x1875453518282880:12345-0@lo:250: Request processed in 294us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571925.285530:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788571925.285573:0:3296:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788571925.285581:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.102@tcp: connect to target with instance 0 00000100:00080000:0.0:1788571925.285588:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788571925.285593:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788571925.285596:0:3296:0:(import.c:65:import_set_state_nolock()) 00000000dc09c37d MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788571925.285598:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788571925.285617:0:3296:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788571925.285621:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011ec5b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3296:1875453518282880:0@lo:250: 00000100:00100000:1.0:1788571925.307893:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788571925.308074:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788571925.308081:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788571925.310129:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788571925.310141:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788571925.317787:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788571925.317821:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788571925.319234:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788571925.319462:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788571925.319469:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788571925.322859:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788571925.322874:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788571925.401848:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788571925.402065:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788571925.402073:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788571925.404759:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788571925.404775:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788571925.406975:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788571925.407187:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788571925.407194:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788571925.409073:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788571925.409085:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788571925.411094:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788571925.411673:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788571925.411680:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788571925.416991:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788571925.417007:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788571925.418074:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788571925.420954:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788571925.420966:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788571925.422177:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788571925.422188:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788571925.467206:0:5811:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788571925.471203:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788571925.471213:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788571925.473625:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788571925.473643:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788571925.476884:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788571925.476898:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788571925.479208:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788571925.479236:0:5811:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788571925.479243:0:5811:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788571925.479828:0:5811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788571925.479872:0:5811:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788571925.479877:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788571925.479879:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788571925.479880:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571925.479881:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571925.479883:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571925.479884:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571925.479885:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788571925.479887:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788571925.479888:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571925.479889:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571925.479891:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571925.479892:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788571925.479894:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788571925.479897:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788571925.479897:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788571925.479898:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571925.479899:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571925.479901:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571925.479901:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571925.479902:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788571925.479903:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788571925.479904:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571925.479912:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571925.479912:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571925.479913:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788571925.479953:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788571925.479971:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9b53541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283008:0@lo:253: 00000100:00100000:2.0:1788571925.480068:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571925.480229:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efe7761d going to sleep for 11 seconds 00000100:00100000:1.0:1788571925.481230:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518283008 00000100:00100000:1.0:1788571925.481241:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518283008 00000100:00100000:0.0:1788571925.484584:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788571925.484618:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c76e3359 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:5811:x1875453518283008:12345-0@lo:253: 20000000:01000000:0.0:1788571925.484696:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788571925.484699:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788571925.485219:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788571925.485323:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788571925.487193:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788571925.489213:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788571925.489803:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788571925.489809:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788571925.489815:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788571925.489818:0:5825:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788571925.489834:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788571925.490150:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788571925.490437:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788571925.490453:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788571925.490499:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788571925.490549:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788571925.490584:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788571925.490697:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788571925.490706:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788571925.490750:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788571925.490758:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788571925.490806:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788571925.490814:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788571925.490844:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788571925.490896:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788571925.490931:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788571925.490936:0:5825:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788571925.490948:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788571925.491158:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788571925.491174:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788571925.491212:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788571925.491271:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788571925.491332:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788571925.491346:0:5825:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788571925.491433:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788571925.491441:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788571925.491485:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788571925.491523:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788571925.491566:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788571925.491577:0:5825:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788571925.491658:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788571925.491666:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788571925.491712:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788571925.491748:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788571925.491912:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788571925.491962:0:5825:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788571925.491969:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788571925.494929:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788571925.499561:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788571925.499600:0:5825:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.102@tcp for mdt 20000000:01000000:0.0:1788571925.499603:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788571925.499670:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788571925.499679:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788571925.499712:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788571925.499720:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:0.0:1788571925.499769:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788571925.499888:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788571925.499921:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788571925.499951:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788571925.500059:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788571925.500062:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788571925.500066:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788571925.500077:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788571925.500080:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788571925.500109:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788571925.500111:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788571925.502148:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788571925.513192:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788571925.513483:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788571925.513520:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788571925.513539:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788571925.513541:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788571925.514150:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788571925.514707:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788571925.514831:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788571925.514915:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788571925.514931:0:5825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788571925.514934:0:5825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788571925.514939:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788571925.514941:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788571925.514947:0:5825:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788571925.514954:0:5825:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788571925.515760:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788571925.515955:0:5825:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788571925.531975:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788571925.532032:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788571925.532109:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788571925.532131:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788571925.532151:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532168:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532178:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532184:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532190:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532195:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532201:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e28121db already unused, calling callback (00000000584b6be2) 00010000:00010000:0.0:1788571925.532204:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532211:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532222:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532270:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.532450:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e28121db/0x977d9e7969bff2b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788571925.532468:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788571925.912624:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c76e3359 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:5811:x1875453518283008:12345-0@lo:253: Request processed in 428011us (432540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571925.912641:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788571925.912754:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9b53541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283008:0@lo:253: 10000000:01000000:2.0:1788571925.912780:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788571925.912784:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788571925.912786:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788571925.912787:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571925.912788:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788571925.912789:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571925.912791:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571925.912792:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788571925.912794:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788571925.912795:0:5811:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788571925.912797:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571925.912798:0:5811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788571925.912820:0:5811:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000008afb825 from lustre-MDT0000 10000000:01000000:2.0:1788571925.912850:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788571925.912853:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788571925.912857:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88c04750cd40 10000000:01000000:2.0:1788571925.912863:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788571925.912871:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88c04750cd40 from 1 10000000:01000000:2.0:1788571925.912874:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788571925.912910:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 000000009ad0d1e6/0x977d9e7969bff2b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571925.912933:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 000000009ad0d1e6/0x977d9e7969bff2b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571925.912945:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 000000009ad0d1e6/0x977d9e7969bff2b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571925.912962:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9b53541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283136:0@lo:101: 00000100:00100000:2.0:1788571925.913005:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571925.913123:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518283136 00000100:00100000:0.0:1788571925.913130:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518283136 00000100:00100000:0.0:1788571925.913173:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788571925.913181:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc989146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:5811:x1875453518283136:12345-0@lo:101: 00010000:00010000:0.0:1788571925.913195:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571925.913208:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e28121db/0x977d9e7969bff2c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff2b9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.913233:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e28121db/0x977d9e7969bff2c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff2b9 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.913243:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e28121db/0x977d9e7969bff2c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff2b9 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571925.913300:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e28121db, rc 0) 00000100:00100000:1.0:1788571925.913366:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc989146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+6:5811:x1875453518283136:12345-0@lo:101: Request processed in 186us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571925.913382:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788571925.913636:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd02f0aa going to sleep for 11 seconds 00000100:00100000:3.0:1788571925.915520:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9b53541 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283136:0@lo:101: 00010000:00010000:3.0:1788571925.915547:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 000000009ad0d1e6/0x977d9e7969bff2b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571925.915563:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 000000009ad0d1e6/0x977d9e7969bff2b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571925.915671:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283264:0@lo:501: 00000100:00100000:3.0:1788571925.915727:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571925.915838:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e19cf58 going to sleep for 11 seconds 00000100:00100000:1.0:1788571925.916403:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518283264 00000100:00100000:1.0:1788571925.916411:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518283264 00000100:00100000:1.0:1788571925.916511:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788571925.916520:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081991ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+6:5811:x1875453518283264:12345-0@lo:501: 00000100:00100000:1.0:1788571925.917438:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081991ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+6:5811:x1875453518283264:12345-0@lo:501: Request processed in 916us (1708us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788571925.917463:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788571925.920051:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283264:0@lo:501: 10000000:01000000:3.0:1788571925.920131:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788571925.920144:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 000000009ad0d1e6/0x977d9e7969bff2b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571925.920155:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 000000009ad0d1e6/0x977d9e7969bff2b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571925.920165:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88c065ad2800 10000000:01000000:3.0:1788571925.920171:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788571925.920175:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88c065ad2800 10000000:01000000:3.0:1788571925.920178:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788571925.920181:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88c065ad2800 from 1 10000000:01000000:3.0:1788571925.920184:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788571925.920220:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 0000000091e4dc56/0x977d9e7969bff2c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571925.920227:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 0000000091e4dc56/0x977d9e7969bff2c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571925.920236:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 0000000091e4dc56/0x977d9e7969bff2c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571925.920549:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283392:0@lo:101: 00000100:00100000:3.0:1788571925.920614:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571925.920718:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e19cf58 going to sleep for 11 seconds 00000100:00100000:1.0:1788571925.926049:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518283392 00000100:00100000:1.0:1788571925.926075:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518283392 00000100:00100000:1.0:1788571925.926130:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788571925.926139:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d7c1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+6:5811:x1875453518283392:12345-0@lo:101: 00010000:00010000:1.0:1788571925.926156:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571925.926179:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab3c98d9/0x977d9e7969bff2ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff2c7 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571925.926205:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab3c98d9/0x977d9e7969bff2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff2c7 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571925.926215:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab3c98d9/0x977d9e7969bff2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff2c7 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571925.926224:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab3c98d9, rc 0) 00000100:00100000:1.0:1788571925.926612:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d7c1416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+7:5811:x1875453518283392:12345-0@lo:101: Request processed in 472us (5996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571925.926627:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788571925.927142:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283392:0@lo:101: 00010000:00010000:3.0:1788571925.927164:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 0000000091e4dc56/0x977d9e7969bff2c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571925.927194:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 0000000091e4dc56/0x977d9e7969bff2c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571925.927216:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788571925.927236:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 0000000091e4dc56/0x977d9e7969bff2c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571925.927243:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 0000000091e4dc56/0x977d9e7969bff2c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571925.927276:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788571925.927281:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788571925.927288:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88c065ad2800 10000000:01000000:3.0:1788571925.927291:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788571925.927297:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788571925.927300:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788571925.927330:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 000000001da306fe/0x977d9e7969bff2d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571925.927338:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 000000001da306fe/0x977d9e7969bff2d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571925.927557:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 000000001da306fe/0x977d9e7969bff2d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571925.927578:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283520:0@lo:101: 00000100:00100000:3.0:1788571925.927694:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571925.927820:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e19cf58 going to sleep for 11 seconds 00000100:00100000:1.0:1788571925.927940:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518283520 00000100:00100000:1.0:1788571925.927947:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518283520 00000100:00100000:1.0:1788571925.928064:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788571925.928148:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c10cfe59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+7:5811:x1875453518283520:12345-0@lo:101: 00010000:00010000:1.0:1788571925.928162:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571925.928174:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6ccbf45/0x977d9e7969bff2dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff2d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571925.928194:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6ccbf45/0x977d9e7969bff2dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff2d5 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571925.928211:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6ccbf45/0x977d9e7969bff2dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff2d5 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571925.928218:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6ccbf45, rc 0) 00000100:00100000:1.0:1788571925.928368:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c10cfe59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+8:5811:x1875453518283520:12345-0@lo:101: Request processed in 223us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571925.928383:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788571925.928602:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283520:0@lo:101: 00010000:00010000:3.0:1788571925.928616:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 000000001da306fe/0x977d9e7969bff2d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571925.930832:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 000000001da306fe/0x977d9e7969bff2d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571925.930927:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283648:0@lo:501: 00000100:00100000:3.0:1788571925.930988:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571925.931213:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e19cf58 going to sleep for 11 seconds 00000100:00100000:1.0:1788571925.931302:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518283648 00000100:00100000:1.0:1788571925.931309:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518283648 00000100:00100000:0.0:1788571925.931491:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788571925.931504:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7e05659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+8:5811:x1875453518283648:12345-0@lo:501: 00000100:00100000:0.0:1788571925.931778:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7e05659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:5811:x1875453518283648:12345-0@lo:501: Request processed in 268us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571925.931786:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788571925.932199:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283648:0@lo:501: 00000100:00100000:3.0:1788571925.932239:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283776:0@lo:503: 00000100:00100000:3.0:1788571925.932315:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571925.932337:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e19cf58 going to sleep for 11 seconds 00000100:00100000:0.0:1788571925.932527:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518283776 00000100:00100000:0.0:1788571925.932536:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518283776 00000100:00100000:0.0:1788571925.932565:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788571925.932571:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c62a4057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:5811:x1875453518283776:12345-0@lo:503: 00000100:00100000:0.0:1788571925.932869:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c62a4057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:5811:x1875453518283776:12345-0@lo:503: Request processed in 297us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571925.932876:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788571925.932900:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518283776:0@lo:503: 00000100:00100000:3.0:1788571925.933674:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5854:1875453518283904:0@lo:502: 00000100:00100000:3.0:1788571925.933721:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571925.933756:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fc5f06d going to sleep for 11 seconds 00000100:00100000:0.0:1788571925.933935:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518283904 00000100:00100000:0.0:1788571925.933939:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518283904 00000100:00100000:0.0:1788571925.933968:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788571925.933975:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dde61585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:5854:x1875453518283904:12345-0@lo:502: 00000100:00100000:0.0:1788571925.934161:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dde61585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:5854:x1875453518283904:12345-0@lo:502: Request processed in 186us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571925.934166:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788571925.934757:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5854:1875453518283904:0@lo:502: 00000020:01000000:3.0:1788571925.934847:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788571925.934857:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788571925.934858:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788571925.934862:0:5854:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788571925.934864:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788571925.934875:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003c85269b) 00000020:00000080:3.0:1788571925.934890:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788571925.934899:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788571925.934971:0:5854:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788571925.934976:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969bff2ea 00000020:00000080:3.0:1788571925.935192:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788571925.935195:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788571925.935197:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788571925.935198:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788571925.935200:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788571925.935202:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788571925.935203:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788571925.935205:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788571925.935210:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000091185292) 00000020:00000080:3.0:1788571925.935216:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788571925.935218:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788571925.935220:0:5854:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788571925.935222:0:5854:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788571925.935227:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788571925.936447:0:5854:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000008afb825 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788571925.936473:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000016ac4cec) 00000020:00000080:3.0:1788571925.936487:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788571925.936550:0:5854:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788571925.936555:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969bff2ff 00000020:00000080:3.0:1788571925.936950:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788571925.936955:0:5854:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788571925.936959:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x977d9e7969bff306 00080000:01000000:3.0:1788571925.936964:0:5854:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788571925.936966:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969bff30d 00080000:10000000:2.0:1788571925.941982:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788571925.942416:0:5854:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788571925.951459:0:5854:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788571926.087081:0:5854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788571926.087481:0:5854:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788571926.092847:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788571926.093148:0:5854:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788571926.178949:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f38a94f7) 00000020:00000080:1.0:1788571926.178979:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788571926.180235:0:5854:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788571926.180263:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969bff31b 00000020:00000080:3.0:1788571926.181169:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788571926.193085:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788571926.248690:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788571926.263525:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788571926.290958:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788571926.378070:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788571926.466321:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788571926.551910:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788571926.629080:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x977d9e7969bff322 00000020:00000080:0.0:1788571926.630299:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788571926.630311:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788571926.630318:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571926.630320:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788571926.630324:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788571926.630328:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571926.630330:0:5854:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788571926.630332:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788571926.630334:0:5854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788571926.630337:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788571926.630339:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571926.630340:0:5854:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788571926.630350:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788571926.630355:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571926.630357:0:5854:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788571926.630361:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788571926.630411:0:5854:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788571926.630591:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000764033d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5854:1875453518284032:0@lo:502: 00000100:00100000:0.0:1788571926.630803:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571926.630919:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000726d19bf going to sleep for 11 seconds 00000100:00100000:3.0:1788571926.640906:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518284032 00000100:00100000:3.0:1788571926.640924:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518284032 00000100:00100000:3.0:1788571926.641015:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788571926.641025:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067bf574d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:5854:x1875453518284032:12345-0@lo:502: 00000100:00100000:3.0:1788571926.646314:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067bf574d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:5854:x1875453518284032:12345-0@lo:502: Request processed in 5282us (15503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571926.646330:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788571926.646598:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000764033d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5854:1875453518284032:0@lo:502: 00000020:01000000:0.0:1788571926.646644:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788571926.646652:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571926.646654:0:5854:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788571926.646661:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788571926.647134:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788571926.647152:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788571926.647174:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 000000001da306fe/0x977d9e7969bff2d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571926.647186:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 000000001da306fe/0x977d9e7969bff2d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571926.647194:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88c065ad2800 from 1 10000000:01000000:3.0:1788571926.647196:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788571926.647416:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571926.647424:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571926.647432:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571926.647578:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284160:0@lo:101: 00000100:00100000:3.0:1788571926.647746:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571926.647889:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049e54573 going to sleep for 11 seconds 00000100:00100000:2.0:1788571926.658177:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518284160 00000100:00100000:2.0:1788571926.658195:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518284160 00000100:00100000:2.0:1788571926.658355:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788571926.658365:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091a77372 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:5811:x1875453518284160:12345-0@lo:101: 00010000:00010000:2.0:1788571926.658393:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788571926.658417:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff329 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.659073:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff329 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.659090:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff329 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.659113:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003f04692a, rc 0) 00000100:00100000:2.0:1788571926.659225:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091a77372 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:5811:x1875453518284160:12345-0@lo:101: Request processed in 861us (11478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571926.659233:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788571926.660105:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284160:0@lo:101: 00010000:00010000:3.0:1788571926.660130:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571926.660156:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571926.661231:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284288:0@lo:256: 00000100:00100000:3.0:1788571926.661335:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571926.666725:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049e54573 going to sleep for 11 seconds 00000100:00100000:2.0:1788571926.672154:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518284288 00000100:00100000:2.0:1788571926.672169:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518284288 00000100:00100000:2.0:1788571926.672241:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788571926.672263:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024a18f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:5811:x1875453518284288:12345-0@lo:256: 20000000:01000000:2.0:1788571926.672289:0:5823:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788571926.672296:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788571926.672454:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024a18f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:5811:x1875453518284288:12345-0@lo:256: Request processed in 192us (11118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571926.672462:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788571926.673198:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284288:0@lo:256: 10000000:01000000:3.0:1788571926.677766:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788571926.677810:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571926.677824:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571926.677833:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c065ad2800 from 1 10000000:01000000:3.0:1788571926.677836:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788571926.677884:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571926.677892:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571926.677901:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571926.677935:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284416:0@lo:101: 00000100:00100000:3.0:1788571926.678003:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571926.678066:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049e54573 going to sleep for 11 seconds 00000100:00100000:2.0:1788571926.678780:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518284416 00000100:00100000:2.0:1788571926.678794:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518284416 00000100:00100000:2.0:1788571926.678843:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788571926.678852:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009233d57a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:5811:x1875453518284416:12345-0@lo:101: 00010000:00010000:2.0:1788571926.678866:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788571926.678882:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff337 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.678904:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff337 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.678914:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff337 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.678935:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000023e1236b, rc 0) 00000100:00100000:2.0:1788571926.678984:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009233d57a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:5811:x1875453518284416:12345-0@lo:101: Request processed in 133us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571926.678990:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788571926.679198:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284416:0@lo:101: 00010000:00010000:3.0:1788571926.679213:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571926.679222:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571926.679308:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284544:0@lo:501: 00000100:00100000:3.0:1788571926.679337:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571926.679365:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049e54573 going to sleep for 11 seconds 00000100:00100000:1.0:1788571926.679718:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518284544 00000100:00100000:1.0:1788571926.679724:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518284544 00000100:00100000:1.0:1788571926.679751:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788571926.679757:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cee444c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:5811:x1875453518284544:12345-0@lo:501: 00000100:00100000:1.0:1788571926.680928:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cee444c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:5811:x1875453518284544:12345-0@lo:501: Request processed in 1166us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571926.680939:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788571926.688476:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284544:0@lo:501: 00000100:00100000:3.0:1788571926.688544:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284672:0@lo:503: 00000100:00100000:3.0:1788571926.688751:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571926.688803:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049e54573 going to sleep for 11 seconds 00000100:00100000:2.0:1788571926.688915:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518284672 00000100:00100000:2.0:1788571926.688923:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518284672 00000100:00100000:2.0:1788571926.688978:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788571926.688987:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be8ec254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:5811:x1875453518284672:12345-0@lo:503: 00000040:00080000:2.0:1788571926.689038:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788571926.689106:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be8ec254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:5811:x1875453518284672:12345-0@lo:503: Request processed in 119us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571926.689115:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788571926.689382:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284672:0@lo:503: 00000040:00080000:3.0:1788571926.690498:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788571926.693749:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788571926.693787:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788571926.693811:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571926.693824:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571926.693961:0:5811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788571926.693965:0:5811:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88c065ad2800 10000000:01000000:0.0:1788571926.693968:0:5811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88c065ad2800 10000000:01000000:0.0:1788571926.693972:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788571926.693979:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c065ad2800 from 1 10000000:01000000:0.0:1788571926.693981:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788571926.694020:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 000000007d7e7d33/0x977d9e7969bff345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.694028:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 000000007d7e7d33/0x977d9e7969bff345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.694038:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 000000007d7e7d33/0x977d9e7969bff345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571926.694061:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000764033d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284800:0@lo:101: 00000100:00100000:0.0:1788571926.694136:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571926.694199:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000726d19bf going to sleep for 11 seconds 00000100:00100000:1.0:1788571926.694898:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518284800 00000100:00100000:1.0:1788571926.694908:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518284800 00000100:00100000:1.0:1788571926.694952:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788571926.694961:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4c54f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:5811:x1875453518284800:12345-0@lo:101: 00010000:00010000:1.0:1788571926.694975:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571926.694989:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e430599/0x977d9e7969bff34c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff345 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571926.695018:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e430599/0x977d9e7969bff34c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff345 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571926.695028:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e430599/0x977d9e7969bff34c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff345 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571926.695037:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e430599, rc 0) 00000100:00100000:1.0:1788571926.695130:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4c54f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5811:x1875453518284800:12345-0@lo:101: Request processed in 169us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571926.695137:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788571926.697741:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000764033d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284800:0@lo:101: 00010000:00010000:0.0:1788571926.697780:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 000000007d7e7d33/0x977d9e7969bff345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.697793:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 000000007d7e7d33/0x977d9e7969bff345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571926.697881:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000764033d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284928:0@lo:501: 00000100:00100000:0.0:1788571926.697944:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571926.697993:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000726d19bf going to sleep for 11 seconds 00000100:00100000:1.0:1788571926.698072:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518284928 00000100:00100000:1.0:1788571926.698079:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518284928 00000100:00100000:1.0:1788571926.698131:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788571926.698139:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae91ee9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5811:x1875453518284928:12345-0@lo:501: 00000100:00100000:1.0:1788571926.698464:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae91ee9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5811:x1875453518284928:12345-0@lo:501: Request processed in 326us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571926.698471:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788571926.698574:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000764033d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518284928:0@lo:501: 00000100:00100000:3.0:1788571926.698627:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518285056:0@lo:503: 00000100:00100000:3.0:1788571926.698671:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571926.698689:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 000000007524e4d0 going to sleep for 11 seconds 00000100:00100000:2.0:1788571926.698807:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518285056 00000100:00100000:2.0:1788571926.698812:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518285056 00000100:00100000:2.0:1788571926.698846:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788571926.698854:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a34e33eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5811:x1875453518285056:12345-0@lo:503: 00000100:00100000:2.0:1788571926.699147:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a34e33eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5811:x1875453518285056:12345-0@lo:503: Request processed in 293us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571926.699153:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788571926.699235:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518285056:0@lo:503: 00000100:00100000:3.0:1788571926.699881:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5860:1875453518285184:0@lo:502: 00000100:00100000:3.0:1788571926.699930:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571926.699963:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000055f44e0 going to sleep for 11 seconds 00000100:00100000:2.0:1788571926.700011:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518285184 00000100:00100000:2.0:1788571926.700017:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518285184 00000100:00100000:2.0:1788571926.700040:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788571926.700046:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e939e2a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5860:x1875453518285184:12345-0@lo:502: 00000100:00100000:2.0:1788571926.700299:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e939e2a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5860:x1875453518285184:12345-0@lo:502: Request processed in 252us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571926.700306:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788571926.700553:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5860:1875453518285184:0@lo:502: 00000020:01000004:3.0:1788571926.700743:0:5860:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788571926.700770:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000037b7c404) 00000020:00000080:3.0:1788571926.700791:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788571926.700877:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000008afb825 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788571926.700882:0:5860:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000008afb825 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788571926.700884:0:5860:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000008afb825 4 00010000:00080000:3.0:1788571926.700915:0:5860:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001e5c5388@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1788571926.704086:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788571926.704321:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788571926.704357:0:5860:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788571926.704379:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x977d9e7969bff35a 00000100:00080000:3.0:1788571926.704391:0:5860:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788571926.704397:0:5860:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001e5c5388 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788571926.704436:0:5860:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b31aedc0 x1875453518285312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788571926.704453:0:5860:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788571926.706697:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518285312:0@lo:38: 00000100:00100000:0.0:1788571926.706791:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571926.712557:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518285312 00000100:00100000:1.0:1788571926.712574:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518285312 00000100:00100000:1.0:1788571926.712894:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788571926.712903:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cd77c94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1875453518285312:12345-0@lo:38: 00000100:00100000:1.0:1788571926.713019:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cd77c94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1875453518285312:12345-0@lo:38: Request processed in 116us (6228us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788571926.713026:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788571926.713303:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788571926.713313:0:3296:0:(import.c:65:import_set_state_nolock()) 000000001e5c5388 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788571926.713318:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788571926.713321:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b31aedc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518285312:0@lo:38: 00000100:00100000:1.0:1788571926.718087:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa4c52f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5860:1875453518285440:0@lo:502: 00000100:00100000:1.0:1788571926.718176:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571926.718229:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518285440 00000100:00100000:1.0:1788571926.718235:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518285440 00000100:00100000:1.0:1788571926.718286:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788571926.718295:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068615ad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5860:x1875453518285440:12345-0@lo:502: 00000100:00100000:1.0:1788571926.718525:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068615ad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5860:x1875453518285440:12345-0@lo:502: Request processed in 231us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571926.718534:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788571926.718593:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ecbf41c5 going to sleep for 11 seconds 00000100:00100000:1.0:1788571926.718928:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa4c52f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5860:1875453518285440:0@lo:502: 00000040:00080000:1.0:1788571926.718955:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788571926.724568:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788571926.724606:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788571926.724632:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 000000007d7e7d33/0x977d9e7969bff345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.724644:0:5811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 000000007d7e7d33/0x977d9e7969bff345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788571926.724701:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788571926.724706:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788571926.724707:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571926.724708:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571926.724709:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571926.724711:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571926.724711:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788571926.724713:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788571926.724714:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571926.724715:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571926.724716:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571926.724718:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788571926.724722:0:5811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788571926.724724:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788571926.724725:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788571926.724727:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571926.724728:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571926.724728:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571926.724730:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571926.724731:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788571926.724731:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788571926.724732:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571926.724733:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571926.724734:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571926.724735:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788571926.724763:0:5811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788571926.724781:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518285568:0@lo:253: 00000100:00100000:2.0:1788571926.724857:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571926.724908:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020c307c8 going to sleep for 11 seconds 00000100:00100000:3.0:1788571926.725120:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518285568 00000100:00100000:3.0:1788571926.725128:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518285568 00000100:00100000:3.0:1788571926.725182:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788571926.725191:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002368678d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5811:x1875453518285568:12345-0@lo:253: 20000000:01000000:3.0:1788571926.725233:0:5824:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788571926.725246:0:5824:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788571926.815566:0:5824:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788571926.815590:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788571926.815712:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788571926.815717:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788571926.815737:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.815759:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff329 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.815767:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.815809:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff329 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.815826:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff329 expref: 12 pid: 5823 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571926.815841:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009aabf032 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1875453518285696:0@lo:104: 00000100:00100000:2.0:1788571926.815905:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571926.815964:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046937e23 going to sleep for 11 seconds 00000100:00100000:3.0:1788571926.817609:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518285696 00000100:00100000:3.0:1788571926.817726:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518285696 00000100:00100000:3.0:1788571926.817789:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788571926.817798:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a1eb685 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5846:x1875453518285696:12345-0@lo:104: 00010000:00010000:3.0:1788571926.817825:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571926.817910:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788571926.817915:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a1eb685 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5846:x1875453518285696:12345-0@lo:104: Request processed in 119us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571926.817921:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788571926.818026:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788571926.818032:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.818039:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000027eb9466 already unused, calling callback (00000000607ca141) 10000000:00010000:2.0:1788571926.818043:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.818050:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788571926.818057:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571926.818070:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788571926.818113:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.818120:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788571926.818138:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.818144:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: 0000000027eb9466/0x977d9e7969bff329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff330 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571926.818161:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571926.818163:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571926.818164:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788571926.818301:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3762fe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518285824:0@lo:103: 00000100:00100000:2.0:1788571926.818340:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571926.818457:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009aabf032 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1875453518285696:0@lo:104: 00010000:00010000:2.0:1788571926.818477:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571926.818558:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518285824 00000100:00100000:0.0:1788571926.818564:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518285824 00010000:00010000:0.0:1788571926.818584:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff329 expref: 13 pid: 5823 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571926.818627:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788571926.818634:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cfdc9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:3298:x1875453518285824:12345-0@lo:103: 00010000:00010000:0.0:1788571926.818645:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788571926.818650:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff329 expref: 13 pid: 5823 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818670:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff329 expref: 13 pid: 5823 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818685:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003f04692a/0x977d9e7969bff330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff329 expref: 13 pid: 5823 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818700:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818708:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788571926.818724:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003006791s 00010000:00010000:0.0:1788571926.818727:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818733:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818739:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818744:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818748:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c66ab0e already unused, calling callback (00000000584b6be2) 00010000:00010000:0.0:1788571926.818751:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818757:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818777:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818787:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788571926.818820:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cfdc9b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:3298:x1875453518285824:12345-0@lo:103: Request processed in 187us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571926.818827:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788571926.818856:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3762fe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518285824:0@lo:103: 00010000:00010000:0.0:1788571926.818872:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818878:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571926.818883:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009c66ab0e/0x977d9e7969bff361 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571926.846113:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002368678d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:5811:x1875453518285568:12345-0@lo:253: Request processed in 120915us (121249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571926.846130:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788571926.846552:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5811:1875453518285568:0@lo:253: 10000000:01000000:2.0:1788571926.846567:0:5811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788571926.846570:0:5811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788571926.846572:0:5811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788571926.846573:0:5811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571926.846575:0:5811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571926.846576:0:5811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571926.846577:0:5811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571926.846578:0:5811:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788571926.846590:0:5811:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788571926.846592:0:5811:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571926.846593:0:5811:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571926.846715:0:5811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571926.846717:0:5811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788571926.846731:0:5811:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788571926.853937:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788571926.854938:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788571926.855166:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788571926.855788:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788571926.855996:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788571926.856166:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788571926.857030:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788571926.857361:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788571926.857753:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788571926.857980:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788571926.858174:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788571926.858810:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788571926.905798:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788571926.954968:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788571926.955545:0:5866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788571926.959820:0:5865:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788571926.959828:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788571926.960179:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788571926.960488:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788571926.961090:0:5811:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788571926.961102:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788571926.961409:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788571926.968927:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788571926.974675:0:5811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788571926.974779:0:5811:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788571926.975074:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788571926.975298:0:5811:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788571926.976704:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788571926.976850:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788571926.977042:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788571926.977181:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788571926.980502:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788571926.981582:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788571926.981845:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788571926.982041:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788571926.982182:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788571926.982348:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788571926.982525:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788571926.982865:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788571926.983079:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788571926.983229:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788571926.983454:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788571926.983590:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788571926.985795:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788571926.985939:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788571926.986089:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788571926.986221:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788571926.986437:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788571926.986576:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788571926.986728:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788571926.986892:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788571926.987045:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788571926.987182:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788571926.987386:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788571926.987527:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788571926.987697:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788571926.987849:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788571926.988007:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788571926.988143:0:5811:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788571926.991013:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788571927.023820:0:5866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788571927.079095:0:5811:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788571927.079137:0:5811:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac68c1dff988 00100000:10000000:3.0:1788571927.079155:0:5811:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788571927.082034:0:5811:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788571927.082051:0:5811:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788571927.082068:0:5811:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788571927.082089:0:5811:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788571927.127749:0:5866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788571927.127831:0:5866:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1788571927.127835:0:5866:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788571927.273027:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571928.298797:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571929.321056:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571930.347038:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571931.374946:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788571931.761410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788571931.761421:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788571931.761424:0:8:0:(import.c:65:import_set_state_nolock()) 000000001e5c5388 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788571931.761437:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001e5c5388 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788571931.761456:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009aabf032 x1875453518286080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788571931.761503:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009aabf032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518286080:0@lo:38: 00000100:00100000:2.0:1788571931.761577:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571931.761817:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518285952:0@lo:400: 00000100:00100000:3.0:1788571931.761851:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571931.762239:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518285952 00000100:00100000:2.0:1788571931.762264:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518285952 00000100:00100000:2.0:1788571931.762310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788571931.762318:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000274bbdfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:3299:x1875453518285952:12345-0@lo:400: 00000100:00100000:2.0:1788571931.762380:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000274bbdfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:3299:x1875453518285952:12345-0@lo:400: Request processed in 63us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571931.762397:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788571931.762452:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518285952:0@lo:400: 00000100:00100000:3.0:1788571931.773918:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518286080 00000100:00100000:3.0:1788571931.773934:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518286080 00000100:00100000:3.0:1788571931.773985:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788571931.773992:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb9fce88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1875453518286080:12345-0@lo:38: 00010000:00080000:3.0:1788571931.774020:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:3.0:1788571931.774057:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x977d9e7969bff368 00000004:00100000:3.0:1788571931.774623:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788571931.774772:0:5832:0:(import.c:65:import_set_state_nolock()) 00000000c03eed6d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788571931.774912:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb9fce88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875453518286080:12345-0@lo:38: Request processed in 919us (13335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571931.774920:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788571931.787197:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009aabf032 x1875453518286080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788571941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788571931.787225:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788571931.787234:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788571931.787240:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788571931.787243:0:3296:0:(import.c:65:import_set_state_nolock()) 000000001e5c5388 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788571931.787265:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009aabf032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518286080:0@lo:38: 10000000:01000000:3.0:1788571932.271872:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788571932.271883:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88c065ad2800 from 3 10000000:01000000:3.0:1788571932.271888:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788571932.271937:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 00000000fc2f679a/0x977d9e7969bff36f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571932.271949:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 00000000fc2f679a/0x977d9e7969bff36f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571932.271960:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 00000000fc2f679a/0x977d9e7969bff36f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571932.271983:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a30cd113 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518286208:0@lo:101: 00000100:00100000:3.0:1788571932.272068:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571932.272604:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518286208 00000100:00100000:0.0:1788571932.272615:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518286208 00000100:00100000:0.0:1788571932.272662:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788571932.272671:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d5658ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:5827:x1875453518286208:12345-0@lo:101: 00010000:00010000:0.0:1788571932.272684:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571932.272697:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e661cae5/0x977d9e7969bff376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff36f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571932.272721:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e661cae5/0x977d9e7969bff376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff36f expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571932.272731:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e661cae5/0x977d9e7969bff376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff36f expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571932.272740:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e661cae5, rc 0) 00000100:00100000:3.0:1788571932.272854:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000700886cc going to sleep for 11 seconds 00000100:00100000:0.0:1788571932.275950:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d5658ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518286208:12345-0@lo:101: Request processed in 3269us (3871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571932.275964:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788571932.276946:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a30cd113 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518286208:0@lo:101: 00010000:00010000:3.0:1788571932.276972:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 00000000fc2f679a/0x977d9e7969bff36f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571932.276984:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 00000000fc2f679a/0x977d9e7969bff36f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571932.277052:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a30cd113 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518286336:0@lo:256: 00000100:00100000:3.0:1788571932.277102:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571932.277575:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000700886cc going to sleep for 11 seconds 00000100:00100000:0.0:1788571932.277973:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518286336 00000100:00100000:0.0:1788571932.277982:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518286336 00000100:00100000:0.0:1788571932.278029:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788571932.278037:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc0b7f27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518286336:12345-0@lo:256: 20000000:01000000:0.0:1788571932.278058:0:5823:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788571932.278075:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788571932.278078:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788571932.278187:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc0b7f27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518286336:12345-0@lo:256: Request processed in 150us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571932.278194:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788571932.288820:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a30cd113 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518286336:0@lo:256: 10000000:01000000:2.0:1788571932.288885:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788571932.288947:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 00000000fc2f679a/0x977d9e7969bff36f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571932.288958:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 00000000fc2f679a/0x977d9e7969bff36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571932.394234:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788571932.882300:0:6108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788571933.438719:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571934.442835:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571935.464568:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571936.491970:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788571936.873838:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518286592:0@lo:400: 00000100:00100000:2.0:1788571936.873909:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571936.873995:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518286592 00000100:00100000:2.0:1788571936.874003:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518286592 00000100:00100000:2.0:1788571936.874048:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788571936.874056:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006052d810 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518286592:12345-0@lo:400: 00000100:00100000:2.0:1788571936.874124:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006052d810 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518286592:12345-0@lo:400: Request processed in 68us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571936.874131:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788571936.874174:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000092cd5ec1 x1875453518286592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571936.874188:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518286592:0@lo:400: 00000100:00100000:0.0:1788571936.874801:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788571936.874815:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009aabf032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518286464:0@lo:400: 00000100:00100000:0.0:1788571936.874863:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571936.876209:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518286464 00000100:00100000:1.0:1788571936.876220:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518286464 00000100:00100000:1.0:1788571936.876311:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788571936.876320:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000942dd806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:3299:x1875453518286464:12345-0@lo:400: 00000100:00100000:1.0:1788571936.876587:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000942dd806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:3299:x1875453518286464:12345-0@lo:400: Request processed in 268us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571936.876603:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788571936.876751:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009aabf032 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518286464:0@lo:400: 00010000:00010000:0.0:1788571937.516188:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571938.536449:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788571938.830105:0:6310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebf16a9e0 20000000:00000080:3.0:1788571938.830125:0:6310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88c07b801400 uarg=0000000000000000 20000000:01000000:3.0:1788571938.830158:0:6310:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788571938.830164:0:6310:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788571938.830169:0:6310:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788571938.830382:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788571938.830395:0:6310:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788571938.834962:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788571938.835215:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788571938.835318:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788571938.835389:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788571938.835407:0:6310:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788571938.835426:0:6310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571938.835445:0:6310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff337 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571938.835458:0:6310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571938.835497:0:6310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff337 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571938.835513:0:6310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff337 expref: 11 pid: 5823 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571938.835526:0:6310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca25ce45 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1875453518286720:0@lo:104: 00000100:00100000:3.0:1788571938.835602:0:6310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571938.835657:0:6310:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014c3aa45 going to sleep for 11 seconds 00000100:00100000:1.0:1788571938.835921:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518286720 00000100:00100000:1.0:1788571938.835928:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518286720 00000100:00100000:1.0:1788571938.835976:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788571938.835984:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e548de4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:6310:x1875453518286720:12345-0@lo:104: 00010000:00010000:1.0:1788571938.836001:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571938.836051:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788571938.836056:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e548de4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:6310:x1875453518286720:12345-0@lo:104: Request processed in 74us (455us total) trans 0 rc 0/0 00010000:00010000:0.0:1788571938.836061:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788571938.836063:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788571938.836066:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836073:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088ee8581 already unused, calling callback (00000000607ca141) 10000000:00010000:0.0:1788571938.836076:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836083:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788571938.836089:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571938.836094:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788571938.836098:0:6310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca25ce45 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1875453518286720:0@lo:104: 00010000:00010000:1.0:1788571938.836114:0:6310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836120:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836126:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788571938.836141:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571938.836154:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1decbd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518286848:0@lo:103: 00010000:00010000:0.0:1788571938.836159:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: 0000000088ee8581/0x977d9e7969bff337 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff33e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836176:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571938.836177:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571938.836179:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571938.836180:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571938.836199:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518286848 00000100:00100000:0.0:1788571938.836203:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518286848 00010000:00010000:0.0:1788571938.836221:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff337 expref: 12 pid: 5823 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571938.836266:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788571938.836273:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa4c52f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:3298:x1875453518286848:12345-0@lo:103: 00010000:00010000:0.0:1788571938.836282:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788571938.836287:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff337 expref: 12 pid: 5823 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836296:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff337 expref: 12 pid: 5823 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836308:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000023e1236b/0x977d9e7969bff33e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff337 expref: 12 pid: 5823 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836320:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836337:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836360:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836378:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836383:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836388:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836392:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1869a67 already unused, calling callback (00000000584b6be2) 00010000:00010000:0.0:1788571938.836395:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836401:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836417:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.836426:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788571938.836457:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa4c52f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:3298:x1875453518286848:12345-0@lo:103: Request processed in 186us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571938.836464:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788571938.836472:0:6310:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571938.836478:0:6310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571938.836483:0:6310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1869a67/0x977d9e7969bff37d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571938.836487:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1decbd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518286848:0@lo:103: 10000000:01000000:1.0:1788571938.946651:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788571938.946679:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c065ad2800 from 1 10000000:01000000:1.0:1788571938.946685:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788571938.946733:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 000000002f395b79/0x977d9e7969bff384 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571938.946745:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 000000002f395b79/0x977d9e7969bff384 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571938.946756:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 000000002f395b79/0x977d9e7969bff384 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571938.946782:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcc5456d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518286976:0@lo:101: 00000100:00100000:1.0:1788571938.946861:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571938.946912:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063f9b9be going to sleep for 11 seconds 00000100:00100000:0.0:1788571938.947404:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518286976 00000100:00100000:0.0:1788571938.947414:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518286976 00000100:00100000:0.0:1788571938.947479:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788571938.947488:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018178de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:5827:x1875453518286976:12345-0@lo:101: 00010000:00010000:0.0:1788571938.947503:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571938.947517:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e2d630eb/0x977d9e7969bff38b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff384 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.947540:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e2d630eb/0x977d9e7969bff38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff384 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.947549:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e2d630eb/0x977d9e7969bff38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff384 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571938.947558:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e2d630eb, rc 0) 00000100:00100000:0.0:1788571938.947611:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018178de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518286976:12345-0@lo:101: Request processed in 125us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571938.947618:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788571938.947766:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcc5456d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518286976:0@lo:101: 00010000:00010000:1.0:1788571938.947782:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 000000002f395b79/0x977d9e7969bff384 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571938.947790:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 000000002f395b79/0x977d9e7969bff384 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571938.947845:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcc5456d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518287104:0@lo:501: 00000100:00100000:1.0:1788571938.947872:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571938.947900:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063f9b9be going to sleep for 11 seconds 00000100:00100000:2.0:1788571938.947945:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518287104 00000100:00100000:2.0:1788571938.947951:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518287104 00000100:00100000:2.0:1788571938.947984:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788571938.947991:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6249fe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518287104:12345-0@lo:501: 00000100:00100000:2.0:1788571938.948217:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6249fe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518287104:12345-0@lo:501: Request processed in 227us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571938.948224:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788571938.948284:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcc5456d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518287104:0@lo:501: 00000100:00100000:2.0:1788571938.948335:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518287232:0@lo:503: 00000100:00100000:2.0:1788571938.948382:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571938.948396:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b898958 going to sleep for 11 seconds 00000100:00100000:2.0:1788571938.948407:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518287232 00000100:00100000:2.0:1788571938.948410:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518287232 00000100:00100000:2.0:1788571938.948426:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788571938.948430:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fc1b642 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518287232:12345-0@lo:503: 00000100:00100000:2.0:1788571938.948541:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fc1b642 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518287232:12345-0@lo:503: Request processed in 110us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571938.948548:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788571938.948583:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518287232:0@lo:503: 00000100:00100000:2.0:1788571938.948781:0:6314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6314:1875453518287360:0@lo:502: 00000100:00100000:2.0:1788571938.948814:0:6314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571938.948832:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518287360 00000100:00100000:2.0:1788571938.948836:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518287360 00000100:00100000:2.0:1788571938.948852:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788571938.948857:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b10e0fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6314:x1875453518287360:12345-0@lo:502: 00000100:00100000:2.0:1788571938.948955:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b10e0fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6314:x1875453518287360:12345-0@lo:502: Request processed in 98us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571938.948962:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788571938.948985:0:6314:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e016e450 going to sleep for 11 seconds 00000100:00100000:2.0:1788571938.948997:0:6314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092cd5ec1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6314:1875453518287360:0@lo:502: 00000020:01000000:2.0:1788571938.949016:0:6314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788571938.949025:0:6314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788571938.949027:0:6314:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788571938.949035:0:6314:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c065ad2800 00000020:00000080:2.0:1788571938.949038:0:6314:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788571938.949078:0:6314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6314:1875453518287488:0@lo:502: 00000100:00100000:2.0:1788571938.949108:0:6314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571938.949126:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518287488 00000100:00100000:2.0:1788571938.949129:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518287488 00000100:00100000:2.0:1788571938.949145:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788571938.949150:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6314:x1875453518287488:12345-0@lo:502: 00000100:00100000:2.0:1788571938.949232:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6314:x1875453518287488:12345-0@lo:502: Request processed in 81us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571938.949239:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788571938.949288:0:6314:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0507f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788571938.949300:0:6314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6314:1875453518287488:0@lo:502: 00000020:01000000:2.0:1788571938.949332:0:6314:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788571938.949337:0:6314:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788571938.949338:0:6314:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788571938.949342:0:6314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788571938.949387:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788571938.949403:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788571938.949412:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571938.949424:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571939.561580:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571940.587879:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571941.608631:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571941.992667:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518287744:0@lo:400: 00000100:00100000:1.0:1788571941.992743:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571941.992805:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788571941.992812:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518287616:0@lo:400: 00000100:00100000:1.0:1788571941.992840:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571941.992893:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518287744 00000100:00100000:1.0:1788571941.992900:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518287744 00000100:00100000:1.0:1788571941.992949:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788571941.992958:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518287744:12345-0@lo:400: 00000100:00100000:1.0:1788571941.993013:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518287744:12345-0@lo:400: Request processed in 56us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571941.993020:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788571941.993061:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518287616 00000100:00100000:1.0:1788571941.993065:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518287616 00000100:00100000:1.0:1788571941.993088:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788571941.993094:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:3300:x1875453518287616:12345-0@lo:400: 00000100:00100000:1.0:1788571941.993125:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:3300:x1875453518287616:12345-0@lo:400: Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571941.993132:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788571941.993400:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518287616:0@lo:400: 00010000:00080000:1.0:1788571941.993419:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88c04754d180 x1875453518287744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571941.993431:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518287744:0@lo:400: 00010000:00010000:3.0:1788571942.632438:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571943.662429:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571944.684727:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571945.704480:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788571946.307024:0:6676:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788571946.307027:0:6676:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788571946.307119:0:6676:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88c0503c8800 00000020:01000004:1.0:1788571946.307135:0:6676:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788571946.307143:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788571946.307153:0:6676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88c0475099c0) 00000020:00000080:1.0:1788571946.307165:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788571946.324324:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788571946.324785:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788571946.345894:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788571946.351245:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788571946.351506:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788571946.351699:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788571946.351718:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788571946.352051:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788571946.352062:0:6676:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788571946.352081:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x977d9e7969bff399 00000020:01000004:3.0:1788571946.352091:0:6676:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788571946.352116:0:6676:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788571946.352120:0:6676:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788571946.352136:0:6676:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788571946.352142:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788571946.352152:0:6676:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88c076484d40) 00000020:00000080:3.0:1788571946.352161:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788571946.356239:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788571946.356519:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788571946.356527:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788571946.372478:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788571946.372500:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788571946.373107:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788571946.373115:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788571946.374912:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788571946.375125:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788571946.375131:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788571946.381585:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788571946.381599:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788571946.419643:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788571946.419901:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788571946.419908:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788571946.422797:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788571946.422819:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788571946.426456:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788571946.426478:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788571946.453089:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788571946.453985:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788571946.453994:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788571946.466969:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788571946.467120:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788571946.599244:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788571946.601012:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788571946.601019:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788571946.609464:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788571946.609482:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788571946.610637:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788571946.610727:0:6676:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788571946.610734:0:6676:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788571946.655125:0:6676:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788571946.655169:0:6676:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788571946.655173:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788571946.655175:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788571946.655176:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788571946.655177:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788571946.655179:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788571946.655181:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788571946.655182:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788571946.655184:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788571946.655185:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788571946.655187:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788571946.655188:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788571946.655192:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788571946.655194:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788571946.655196:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788571946.655197:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788571946.655202:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788571946.655203:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788571946.655204:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788571946.655205:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788571946.655205:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788571946.655206:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788571946.655207:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788571946.655208:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788571946.655237:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788571946.655283:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518287872:0@lo:253: 00000100:00100000:3.0:1788571946.655367:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571946.655422:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788571946.655846:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518287872 00000100:00100000:0.0:1788571946.655856:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518287872 00000100:00100000:0.0:1788571946.655908:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788571946.655916:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518287872:12345-0@lo:253: 20000000:01000000:0.0:1788571946.655946:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788571946.655950:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788571946.655956:0:5824:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788571946.655959:0:5824:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788571946.657743:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788571946.657988:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788571946.658006:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788571946.658047:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788571946.658056:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788571946.658088:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788571946.658137:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788571946.659964:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788571946.659998:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:0.0:1788571946.660000:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788571946.660033:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788571946.660040:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788571946.660085:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788571946.660092:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:0.0:1788571946.660123:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788571946.660131:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788571946.660158:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788571946.660202:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788571946.672867:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788571946.672902:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:1.0:1788571946.672905:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:1.0:1788571946.672949:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788571946.672958:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788571946.672989:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788571946.672996:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:1.0:1788571946.673044:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788571946.673055:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788571946.673090:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788571946.673126:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788571946.673145:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788571946.673147:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788571946.673151:0:5824:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788571946.673163:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788571946.673166:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788571946.673201:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788571946.673204:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788571946.681278:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788571946.681939:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788571946.681982:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788571946.682073:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788571946.682090:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788571946.682093:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788571946.684196:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788571946.687092:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788571946.687214:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788571946.687703:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788571946.687748:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788571946.687779:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788571946.687793:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788571946.687796:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788571946.691795:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788571946.691903:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788571946.691961:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788571946.692465:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788571946.692509:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788571946.692574:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788571946.692607:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788571946.692609:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788571946.692620:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788571946.692655:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.692673:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c040030400/0x977d9e7969bff2c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff2b9 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.692682:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db3800/0x977d9e7969bff2dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff2d5 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.692689:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff345 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.692695:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.692733:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db2200/0x977d9e7969bff34c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff345 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.692750:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff34c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff345 expref: 12 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571946.692765:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518288000:0@lo:104: 00000100:00100000:1.0:1788571946.692833:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788571946.692894:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db3800/0x977d9e7969bff2dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff2d5 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.692903:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c046db3800/0x977d9e7969bff2dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff2d5 expref: 12 pid: 5825 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571946.692911:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518288128:0@lo:104: 00000100:00100000:1.0:1788571946.692933:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788571946.692970:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c040030400/0x977d9e7969bff2c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff2b9 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.692979:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c040030400/0x977d9e7969bff2c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff2b9 expref: 12 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571946.692987:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518288256:0@lo:104: 00000100:00100000:1.0:1788571946.693007:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571946.693017:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0507bcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788571946.693349:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518288000 00000100:00100000:2.0:1788571946.693358:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518288000 00000100:00100000:2.0:1788571946.693394:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518288128 00000100:00100000:2.0:1788571946.693396:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518288128 00000100:00100000:2.0:1788571946.693405:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518288256 00000100:00100000:2.0:1788571946.693407:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518288256 00000100:00100000:2.0:1788571946.693419:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788571946.693428:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:5824:x1875453518288000:12345-0@lo:104: 00010000:00010000:2.0:1788571946.693452:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c040030a00/0x977d9e7969bff345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693516:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788571946.693522:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:5824:x1875453518288000:12345-0@lo:104: Request processed in 96us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.693529:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788571946.693547:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788571946.693554:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:5824:x1875453518288128:12345-0@lo:104: 00010000:00010000:2.0:1788571946.693563:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff2d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693610:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788571946.693614:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:5824:x1875453518288128:12345-0@lo:104: Request processed in 62us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.693620:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788571946.693631:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788571946.693637:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5824:x1875453518288256:12345-0@lo:104: 00010000:00010000:2.0:1788571946.693644:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff2b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693682:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788571946.693687:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5824:x1875453518288256:12345-0@lo:104: Request processed in 51us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.693691:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788571946.693709:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788571946.693715:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c040030a00/0x977d9e7969bff345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693730:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040030a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788571946.693734:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c040030a00/0x977d9e7969bff345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693742:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040030a00/0x977d9e7969bff345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788571946.693748:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040030a00/0x977d9e7969bff345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571946.693753:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788571946.693783:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c040030a00/0x977d9e7969bff345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693789:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788571946.693807:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c040030a00/0x977d9e7969bff345 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693814:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040030a00/0x977d9e7969bff345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff34c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693830:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788571946.693833:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff2d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693838:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788571946.693841:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff2d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693855:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788571946.693862:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571946.693867:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788571946.693878:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff2d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693884:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788571946.693889:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff2d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693895:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff2d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff2dc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693903:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788571946.693906:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff2b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693911:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041522a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788571946.693914:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff2b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693920:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788571946.693925:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571946.693934:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788571946.693945:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff2b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693950:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788571946.693962:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff2b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693969:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff2b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff2c0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.693984:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571946.693986:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571946.693987:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571946.693993:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788571946.694012:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518288384:0@lo:103: 00000100:00100000:2.0:1788571946.694043:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571946.694069:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788571946.694075:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518288512:0@lo:103: 00000100:00100000:2.0:1788571946.694095:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571946.694124:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518288640:0@lo:103: 00000100:00100000:2.0:1788571946.694143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571946.694173:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518288384 00000100:00100000:2.0:1788571946.694177:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518288384 00010000:00010000:2.0:1788571946.694194:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db2200/0x977d9e7969bff34c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff345 expref: 13 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571946.694208:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518288512 00000100:00100000:2.0:1788571946.694219:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518288512 00010000:00010000:2.0:1788571946.694231:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db3800/0x977d9e7969bff2dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff2d5 expref: 14 pid: 5825 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571946.694242:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518288640 00000100:00100000:2.0:1788571946.694244:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518288640 00010000:00010000:2.0:1788571946.694289:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c040030400/0x977d9e7969bff2c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff2b9 expref: 15 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571946.694313:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788571946.694319:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:3297:x1875453518288384:12345-0@lo:103: 00010000:00010000:2.0:1788571946.694332:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788571946.694337:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db2200/0x977d9e7969bff34c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff345 expref: 15 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694348:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db2200/0x977d9e7969bff34c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff345 expref: 15 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694364:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788571946.694391:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:3297:x1875453518288384:12345-0@lo:103: Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.694397:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788571946.694409:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788571946.694415:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:3297:x1875453518288512:12345-0@lo:103: 00010000:00010000:2.0:1788571946.694422:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788571946.694426:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db3800/0x977d9e7969bff2dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff2d5 expref: 14 pid: 5825 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694434:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db3800/0x977d9e7969bff2dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff2d5 expref: 14 pid: 5825 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694455:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788571946.694479:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:3297:x1875453518288512:12345-0@lo:103: Request processed in 64us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.694484:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788571946.694497:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788571946.694503:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:3299:x1875453518288640:12345-0@lo:103: 00010000:00010000:2.0:1788571946.694523:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788571946.694528:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c040030400/0x977d9e7969bff2c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff2b9 expref: 13 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694536:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c040030400/0x977d9e7969bff2c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff2b9 expref: 13 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694547:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694556:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694569:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694577:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694583:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694590:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694600:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db2c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788571946.694604:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694611:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694618:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.694627:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788571946.694652:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:3299:x1875453518288640:12345-0@lo:103: Request processed in 150us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.694657:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788571946.694690:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518288640:0@lo:103: 00000100:00100000:2.0:1788571946.694712:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518288512:0@lo:103: 00000100:00100000:2.0:1788571946.694719:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518288384:0@lo:103: 00010000:00010000:1.0:1788571946.695336:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff34c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff345 expref: 12 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571946.695353:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518288000:0@lo:104: 00010000:00010000:1.0:1788571946.695366:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3800/0x977d9e7969bff2dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff2d5 expref: 11 pid: 5825 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571946.695373:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518288128:0@lo:104: 00010000:00010000:1.0:1788571946.695383:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030400/0x977d9e7969bff2c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff2b9 expref: 10 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571946.695392:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518288256:0@lo:104: 00010000:00010000:1.0:1788571946.695409:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.695420:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.695426:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.695444:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788571946.695459:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1788571946.728472:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788571946.821359:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:6676:x1875453518287872:12345-0@lo:253: Request processed in 165431us (165980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.821375:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788571946.824892:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518287872:0@lo:253: 10000000:01000000:3.0:1788571946.825044:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788571946.825049:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788571946.825050:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788571946.825052:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788571946.825053:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788571946.825055:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788571946.825056:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788571946.825057:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788571946.825059:0:6676:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788571946.825061:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788571946.825063:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788571946.828857:0:6676:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88c0503c8800 from lustre-OST0000 10000000:01000000:2.0:1788571946.828899:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788571946.828902:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788571946.829042:0:6676:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88c04750cd40 local copy 10000000:01000000:2.0:1788571946.829048:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788571946.829090:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.829115:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.829128:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571946.829152:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518288768:0@lo:101: 00000100:00100000:2.0:1788571946.829226:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571946.829385:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05b1cfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788571946.833016:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518288768 00000100:00100000:1.0:1788571946.833035:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518288768 00000100:00100000:1.0:1788571946.833159:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788571946.833170:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:6676:x1875453518288768:12345-0@lo:101: 00010000:00010000:1.0:1788571946.833187:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571946.833207:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff3ae expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.833234:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff3ae expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.833245:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff3ae expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.833274:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2c00, rc 0) 00000100:00100000:1.0:1788571946.833369:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:6676:x1875453518288768:12345-0@lo:101: Request processed in 201us (4143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571946.833377:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788571946.833476:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518288768:0@lo:101: 00010000:00010000:3.0:1788571946.833494:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.833503:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571946.833643:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518288896:0@lo:501: 00000100:00100000:3.0:1788571946.833676:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571946.839802:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788571946.841535:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518288896 00000100:00100000:2.0:1788571946.841721:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518288896 00000100:00100000:2.0:1788571946.841791:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788571946.841803:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:6676:x1875453518288896:12345-0@lo:501: 00000100:00100000:2.0:1788571946.842395:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:6676:x1875453518288896:12345-0@lo:501: Request processed in 592us (8715us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788571946.842403:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788571946.845234:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518288896:0@lo:501: 10000000:01000000:0.0:1788571946.845400:0:6676:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788571946.845467:0:6676:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788571946.845477:0:6676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.845500:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.845507:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.845547:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788571946.845570:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88c0503c8800 10000000:01000000:0.0:1788571946.845575:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788571946.845688:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88c04750cd40 10000000:01000000:0.0:1788571946.845692:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788571946.845696:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88c04750cd40 from 1 10000000:01000000:0.0:1788571946.845699:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788571946.845733:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.845742:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.845752:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571946.845772:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289024:0@lo:101: 00000100:00100000:0.0:1788571946.845832:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571946.845881:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788571946.846169:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788571946.846178:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.846186:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041522a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788571946.846190:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.846198:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788571946.846206:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571946.846220:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788571946.846241:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.846286:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788571946.846315:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.846323:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff3ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x977d9e7969bff3b5 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.846340:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571946.846342:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571946.846344:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788571946.846352:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788571946.846365:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518289152:0@lo:103: 00000100:00100000:2.0:1788571946.846400:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571946.846432:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518289152 00000100:00100000:2.0:1788571946.846438:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518289152 00000100:00100000:2.0:1788571946.846487:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788571946.846497:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:3299:x1875453518289152:12345-0@lo:103: 00010000:00010000:2.0:1788571946.846511:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788571946.846524:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff3b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff3ae expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.846554:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788571946.846722:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:3299:x1875453518289152:12345-0@lo:103: Request processed in 226us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.846738:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788571946.846775:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518289152:0@lo:103: 00000100:00100000:3.0:1788571946.846849:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518289024 00000100:00100000:3.0:1788571946.846854:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518289024 00000100:00100000:3.0:1788571946.846892:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788571946.846899:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:6676:x1875453518289024:12345-0@lo:101: 00010000:00010000:3.0:1788571946.846910:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571946.846922:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041386e00/0x977d9e7969bff3c3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff3bc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.846944:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041386e00/0x977d9e7969bff3c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff3bc expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.846954:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041386e00/0x977d9e7969bff3c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff3bc expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.846972:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386e00, rc 0) 00000100:00100000:3.0:1788571946.847007:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:6676:x1875453518289024:12345-0@lo:101: Request processed in 109us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571946.847012:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788571946.847302:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289024:0@lo:101: 00010000:00010000:0.0:1788571946.847318:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3c3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.847339:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff3c3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571946.847358:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788571946.847379:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3c3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.847386:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3c3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571946.847394:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788571946.847399:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788571946.847404:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788571946.847407:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788571946.847425:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.847432:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.847439:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571946.847453:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289280:0@lo:101: 00000100:00100000:0.0:1788571946.847485:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571946.847513:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518289280 00000100:00100000:0.0:1788571946.847530:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518289280 00000100:00100000:0.0:1788571946.847903:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788571946.847922:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+10:6676:x1875453518289280:12345-0@lo:101: 00010000:00010000:0.0:1788571946.847940:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571946.847949:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff3ca expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.848154:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff3ca expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.848165:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff3ca expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.848173:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030200, rc 0) 00000100:00100000:0.0:1788571946.848206:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289280:12345-0@lo:101: Request processed in 295us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571946.848212:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788571946.848306:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788571946.848324:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289280:0@lo:101: 00010000:00010000:0.0:1788571946.848335:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.848342:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571946.848445:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289408:0@lo:501: 00000100:00100000:0.0:1788571946.848471:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571946.848494:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518289408 00000100:00100000:0.0:1788571946.848498:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518289408 00000100:00100000:0.0:1788571946.848536:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788571946.848543:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289408:12345-0@lo:501: 00000100:00100000:2.0:1788571946.849450:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788571946.850463:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289408:12345-0@lo:501: Request processed in 1913us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571946.850474:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788571946.850843:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289408:0@lo:501: 00000100:00100000:0.0:1788571946.855355:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289536:0@lo:503: 00000100:00100000:0.0:1788571946.855451:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571946.855501:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788571946.855925:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518289536 00000100:00100000:2.0:1788571946.855935:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518289536 00000100:00100000:2.0:1788571946.856006:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788571946.856016:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289536:12345-0@lo:503: 00000100:00100000:2.0:1788571946.856311:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289536:12345-0@lo:503: Request processed in 296us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.856319:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788571946.856617:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289536:0@lo:503: 00000040:00080000:3.0:1788571946.856921:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788571946.857017:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289664:0@lo:502: 00000100:00100000:3.0:1788571946.857068:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571946.857105:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788571946.858098:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518289664 00000100:00100000:2.0:1788571946.858108:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518289664 00000100:00100000:2.0:1788571946.858156:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788571946.858166:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289664:12345-0@lo:502: 00000100:00100000:2.0:1788571946.858443:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289664:12345-0@lo:502: Request processed in 278us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.858451:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788571946.861749:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289664:0@lo:502: 00000040:00080000:3.0:1788571946.862283:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788571946.862365:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788571946.862414:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788571946.862462:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788571946.862496:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788571946.862528:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788571946.864064:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289792:0@lo:502: 00000100:00100000:3.0:1788571946.864163:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571946.864224:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788571946.864442:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518289792 00000100:00100000:2.0:1788571946.864451:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518289792 00000100:00100000:2.0:1788571946.864506:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788571946.864515:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289792:12345-0@lo:502: 00000100:00100000:2.0:1788571946.865780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289792:12345-0@lo:502: Request processed in 1261us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.865792:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788571946.866355:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289792:0@lo:502: 00000040:00080000:3.0:1788571946.866513:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788571946.867031:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788571946.868486:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788571946.868497:0:6694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788571946.868503:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571946.868506:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788571946.868512:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788571946.869031:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88c058eecd40) 00000020:00000080:0.0:1788571946.869058:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788571946.869068:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788571946.869154:0:6694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88c0503c8800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788571946.869162:0:6694:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788571946.869169:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x977d9e7969bff3df 00010000:00010000:2.0:1788571946.887425:0:6694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788571946.889560:0:6694:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788571946.891730:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788571946.892028:0:6694:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788571946.918141:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788571946.921429:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788571946.926355:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788571946.926370:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788571946.926377:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571946.926380:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788571946.926383:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788571946.926388:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571946.926390:0:6694:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788571946.926393:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788571946.926395:0:6694:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788571946.926467:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788571946.926471:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571946.926472:0:6694:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788571946.926476:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788571946.927801:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788571946.927838:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788571946.927862:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.927874:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571946.927901:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c0503c8800 from 1 10000000:01000000:3.0:1788571946.927903:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788571946.927947:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.927968:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.928003:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571946.928030:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289920:0@lo:101: 00000100:00100000:3.0:1788571946.928122:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571946.928167:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518289920 00000100:00100000:3.0:1788571946.928174:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518289920 00000100:00100000:3.0:1788571946.928216:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788571946.928225:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:6676:x1875453518289920:12345-0@lo:101: 00010000:00010000:3.0:1788571946.928238:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571946.928282:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff3e6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.928320:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff3e6 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.928331:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff3e6 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.928339:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386800, rc 0) 00000100:00100000:3.0:1788571946.928376:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518289920:12345-0@lo:101: Request processed in 152us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571946.928383:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788571946.928436:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788571946.928460:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518289920:0@lo:101: 00010000:00010000:3.0:1788571946.928475:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571946.928484:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571946.929727:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290048:0@lo:501: 00000100:00100000:3.0:1788571946.929796:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571946.929832:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788571946.930215:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518290048 00000100:00100000:0.0:1788571946.930229:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518290048 00000100:00100000:0.0:1788571946.931406:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788571946.931423:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518290048:12345-0@lo:501: 00000100:00100000:0.0:1788571946.932224:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518290048:12345-0@lo:501: Request processed in 804us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571946.932234:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788571946.935469:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290048:0@lo:501: 00000100:00100000:3.0:1788571946.935554:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290176:0@lo:503: 00000100:00100000:3.0:1788571946.935630:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571946.935679:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518290176 00000100:00100000:3.0:1788571946.935685:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518290176 00000100:00100000:3.0:1788571946.935735:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788571946.935744:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518290176:12345-0@lo:503: 00000100:00100000:3.0:1788571946.936413:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518290176:12345-0@lo:503: Request processed in 668us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571946.936423:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788571946.936477:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788571946.936494:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290176:0@lo:503: 00000040:00080000:3.0:1788571946.936937:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788571946.937701:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290304:0@lo:502: 00000100:00100000:3.0:1788571946.937772:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571946.937807:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788571946.938363:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518290304 00000100:00100000:2.0:1788571946.938372:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518290304 00000100:00100000:2.0:1788571946.938419:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788571946.938427:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518290304:12345-0@lo:502: 00000100:00100000:2.0:1788571946.939319:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518290304:12345-0@lo:502: Request processed in 889us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.939329:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788571946.948126:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290304:0@lo:502: 00000040:00080000:1.0:1788571946.948494:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788571946.949079:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788571946.949124:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290432:0@lo:502: 00000100:00100000:1.0:1788571946.949206:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571946.949351:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0507bcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788571946.957088:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518290432 00000100:00100000:2.0:1788571946.957103:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518290432 00000100:00100000:2.0:1788571946.957166:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788571946.957176:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518290432:12345-0@lo:502: 00000100:00100000:2.0:1788571946.957478:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518290432:12345-0@lo:502: Request processed in 302us (8271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.957485:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788571946.957708:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290432:0@lo:502: 00000040:00080000:0.0:1788571946.957862:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788571946.957876:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788571946.958169:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788571946.958178:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571946.958181:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788571946.958189:0:6698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c0503c8800 00000020:00000080:0.0:1788571946.958191:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788571946.958207:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788571946.958210:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571946.958212:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788571946.958214:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788571946.958241:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788571946.958276:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788571946.958290:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.958310:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571946.958353:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788571946.958356:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88c0503c8800 10000000:01000000:0.0:1788571946.958359:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88c0503c8800 10000000:01000000:0.0:1788571946.958363:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788571946.958377:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c0503c8800 from 1 10000000:01000000:0.0:1788571946.958379:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788571946.958412:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.958420:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.958429:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571946.958447:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290560:0@lo:101: 00000100:00100000:0.0:1788571946.958492:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571946.958552:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518290560 00000100:00100000:1.0:1788571946.958558:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518290560 00000100:00100000:1.0:1788571946.958596:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788571946.958605:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518290560:12345-0@lo:101: 00010000:00010000:1.0:1788571946.958616:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571946.958629:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff3f4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.958652:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff3f4 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.958674:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff3f4 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571946.958682:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db3800, rc 0) 00000100:00100000:1.0:1788571946.958713:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518290560:12345-0@lo:101: Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571946.958719:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788571946.958736:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788571946.958752:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290560:0@lo:101: 00010000:00010000:0.0:1788571946.958765:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571946.958773:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571946.958838:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290688:0@lo:501: 00000100:00100000:0.0:1788571946.958863:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571946.958883:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571946.959066:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518290688 00000100:00100000:3.0:1788571946.959071:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518290688 00000100:00100000:3.0:1788571946.959091:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788571946.959098:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518290688:12345-0@lo:501: 00000100:00100000:3.0:1788571946.959352:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518290688:12345-0@lo:501: Request processed in 254us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571946.959360:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788571946.959700:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290688:0@lo:501: 00000100:00100000:0.0:1788571946.959731:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290816:0@lo:503: 00000100:00100000:0.0:1788571946.959773:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571946.959804:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571946.959863:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518290816 00000100:00100000:3.0:1788571946.959873:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518290816 00000100:00100000:3.0:1788571946.959904:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788571946.959911:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518290816:12345-0@lo:503: 00000100:00100000:3.0:1788571946.960074:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518290816:12345-0@lo:503: Request processed in 163us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571946.960081:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788571946.960277:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290816:0@lo:503: 00000040:00080000:0.0:1788571946.960722:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788571946.960790:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290944:0@lo:502: 00000100:00100000:0.0:1788571946.960838:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571946.960877:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788571946.961237:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518290944 00000100:00100000:1.0:1788571946.961243:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518290944 00000100:00100000:1.0:1788571946.961321:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788571946.961331:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518290944:12345-0@lo:502: 00000100:00100000:1.0:1788571946.961517:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518290944:12345-0@lo:502: Request processed in 186us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571946.961784:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788571946.962146:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518290944:0@lo:502: 00000040:00080000:0.0:1788571946.962897:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788571946.963035:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788571946.963073:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788571946.963139:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788571946.963176:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788571946.966098:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788571946.966172:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788571946.966200:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788571946.969731:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788571946.969780:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788571946.969813:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788571946.969859:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788571946.969896:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788571946.969929:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788571946.970075:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788571946.970115:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788571946.970146:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788571946.970190:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788571946.970221:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788571946.970353:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788571946.970404:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788571946.970441:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788571946.970475:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788571946.970534:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788571946.970580:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788571946.970616:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788571946.970666:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788571946.970703:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788571946.970755:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518291072:0@lo:502: 00000100:00100000:0.0:1788571946.970846:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571946.970900:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788571946.971441:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518291072 00000100:00100000:2.0:1788571946.971450:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518291072 00000100:00100000:2.0:1788571946.971505:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788571946.971514:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518291072:12345-0@lo:502: 00000100:00100000:2.0:1788571946.971755:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518291072:12345-0@lo:502: Request processed in 241us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.971762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788571946.972237:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076236a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518291072:0@lo:502: 00000040:00080000:0.0:1788571946.972750:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788571946.972764:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788571946.973400:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788571946.973419:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88c058eeb380) 00000020:00000080:0.0:1788571946.973438:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788571946.973642:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88c0503c8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788571946.973647:0:6699:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c0503c8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788571946.973650:0:6699:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c0503c8800 3 00010000:00080000:0.0:1788571946.973688:0:6699:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c076338000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1788571946.978800:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788571946.979092:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788571946.979153:0:6699:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788571946.979171:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x977d9e7969bff409 00000100:00080000:2.0:1788571946.979185:0:6699:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788571946.979191:0:6699:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88c076338000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788571946.979280:0:6699:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c075da6680 x1875453518291200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788571946.979315:0:6699:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788571946.979701:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788571946.979717:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518291328:0@lo:400: 00000100:00100000:3.0:1788571946.979786:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571946.979830:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518291328 00000100:00100000:3.0:1788571946.979836:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518291328 00000100:00100000:3.0:1788571946.979879:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788571946.979887:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518291328:12345-0@lo:400: 00000100:00100000:3.0:1788571946.979936:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518291328:12345-0@lo:400: Request processed in 49us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571946.979943:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788571946.979998:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88c07c556300 x1875453518291328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788571946.980011:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518291328:0@lo:400: 00000100:00100000:0.0:1788571946.980427:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518291200:0@lo:38: 00000100:00100000:0.0:1788571946.980461:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788571946.980762:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1788571946.981545:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518291200 00000100:00100000:2.0:1788571946.981553:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518291200 00000100:00100000:2.0:1788571946.981586:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788571946.981593:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3296:x1875453518291200:12345-0@lo:38: 00010000:00080000:2.0:1788571946.981617:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:2.0:1788571946.981653:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x977d9e7969bff410 00000004:00100000:2.0:1788571946.981668:0:5831:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788571946.981697:0:5831:0:(import.c:65:import_set_state_nolock()) ffff88c07f749000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788571946.981764:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875453518291200:12345-0@lo:38: Request processed in 169us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571946.981771:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1788571946.981794:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788571946.981822:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788571946.981834:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571946.981846:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788571946.981894:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788571946.981899:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788571946.981900:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571946.981901:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571946.981902:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571946.981903:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571946.981905:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788571946.981906:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571946.981908:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571946.981909:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571946.981910:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788571946.981914:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788571946.981917:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788571946.981918:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788571946.981919:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571946.981920:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571946.981921:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571946.981922:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571946.981923:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788571946.981923:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571946.981924:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571946.981925:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571946.981926:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788571946.981945:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788571946.981971:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518291456:0@lo:253: 00000100:00100000:2.0:1788571946.982010:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571946.982042:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05218d9c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788571946.982347:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88c075da6680 x1875453518291200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788571956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571946.982358:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788571946.982366:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788571946.982375:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788571946.982379:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788571946.982382:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c076338000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788571946.982388:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518291200:0@lo:38: 00000100:00100000:2.0:1788571946.982589:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518291456 00000100:00100000:2.0:1788571946.982595:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518291456 00000100:00100000:2.0:1788571946.982668:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788571946.982677:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:6676:x1875453518291456:12345-0@lo:253: 20000000:01000000:2.0:1788571946.982710:0:5823:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788571946.982722:0:5823:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788571947.066097:0:5823:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788571947.066114:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788571947.066383:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788571947.066388:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788571947.066412:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571947.066431:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c040030600/0x977d9e7969bff376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff36f expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571947.066440:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571947.066481:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c040030600/0x977d9e7969bff376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff36f expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571947.066496:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c040030600/0x977d9e7969bff376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff36f expref: 13 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571947.066511:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1875453518291584:0@lo:104: 00000100:00100000:0.0:1788571947.066708:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571947.067113:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571947.075853:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518291584 00000100:00100000:3.0:1788571947.075874:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518291584 00000100:00100000:3.0:1788571947.075946:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788571947.075968:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5846:x1875453518291584:12345-0@lo:104: 00010000:00010000:3.0:1788571947.075991:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076119:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788571947.076126:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5846:x1875453518291584:12345-0@lo:104: Request processed in 171us (9418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571947.076134:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788571947.076158:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788571947.076164:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076171:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788571947.076175:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076182:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788571947.076188:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571947.076193:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788571947.076243:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff36f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076271:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788571947.076289:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff36f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076307:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff36f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff376 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076336:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571947.076338:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571947.076340:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571947.076362:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518291712:0@lo:103: 00000100:00100000:3.0:1788571947.076401:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571947.076454:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518291712 00000100:00100000:3.0:1788571947.076458:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518291712 00010000:00010000:3.0:1788571947.076476:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c040030600/0x977d9e7969bff376 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff36f expref: 14 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571947.076496:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788571947.076502:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058e7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:3298:x1875453518291712:12345-0@lo:103: 00010000:00010000:3.0:1788571947.076511:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788571947.076516:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c040030600/0x977d9e7969bff376 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff36f expref: 14 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076539:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c040030600/0x977d9e7969bff376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff36f expref: 14 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076556:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076564:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788571947.076578:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010190729s 00010000:00010000:3.0:1788571947.076583:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076600:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076606:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076611:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076617:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040030400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788571947.076621:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076628:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076820:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571947.076831:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788571947.076864:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058e7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:3298:x1875453518291712:12345-0@lo:103: Request processed in 362us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571947.076870:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788571947.076930:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c556300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518291712:0@lo:103: 00010000:00010000:0.0:1788571947.077927:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030600/0x977d9e7969bff376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff36f expref: 13 pid: 5824 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571947.077943:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1875453518291584:0@lo:104: 00010000:00010000:0.0:1788571947.078018:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571947.078029:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571947.078036:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571947.078053:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030400/0x977d9e7969bff417 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571947.085896:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:6676:x1875453518291456:12345-0@lo:253: Request processed in 103209us (103874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571947.085926:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788571947.085936:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:6676:1875453518291456:0@lo:253: 10000000:01000000:2.0:1788571947.085954:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788571947.085958:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788571947.085965:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788571947.085966:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571947.085968:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571947.085969:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571947.085970:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571947.085971:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788571947.085973:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571947.085974:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571947.085976:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571947.085977:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788571947.085994:0:6676:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788571947.089572:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788571947.089745:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788571947.089910:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788571947.090054:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788571947.090185:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788571947.090428:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788571947.091770:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788571947.376750:0:6676:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788571947.376757:0:6676:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788571947.376790:0:6676:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788571947.376850:0:6676:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788571947.376865:0:6676:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788571947.376893:0:6676:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788571947.761844:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571948.782609:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571949.800781:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571950.825108:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571951.849920:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788571952.233195:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518291968:0@lo:400: 00000100:00100000:0.0:1788571952.233293:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571952.233358:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788571952.233364:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518291840:0@lo:400: 00000100:00100000:0.0:1788571952.233399:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571952.233432:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518292096:0@lo:400: 00000100:00100000:0.0:1788571952.233468:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571952.233854:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518291968 00000100:00100000:0.0:1788571952.233865:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518291968 00000100:00100000:0.0:1788571952.233905:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518292096 00000100:00100000:0.0:1788571952.233909:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518292096 00000100:00100000:0.0:1788571952.233935:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788571952.233942:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518291968:12345-0@lo:400: 00000100:00100000:0.0:1788571952.233998:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518291968:12345-0@lo:400: Request processed in 55us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571952.234005:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788571952.234023:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788571952.234029:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518292096:12345-0@lo:400: 00000100:00100000:0.0:1788571952.234060:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518292096:12345-0@lo:400: Request processed in 32us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571952.234066:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788571952.234083:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518291840 00000100:00100000:0.0:1788571952.234101:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518291840 00000100:00100000:0.0:1788571952.234127:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788571952.234134:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:3300:x1875453518291840:12345-0@lo:400: 00000100:00100000:0.0:1788571952.234162:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:3300:x1875453518291840:12345-0@lo:400: Request processed in 29us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571952.234168:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788571952.234199:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788571952.234234:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c076236680 x1875453518292096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571952.234270:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518292096:0@lo:400: 00000100:00100000:0.0:1788571952.234315:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518291840:0@lo:400: 00010000:00080000:0.0:1788571952.234327:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c076235f80 x1875453518291968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571952.234336:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518291968:0@lo:400: 00010000:00010000:0.0:1788571952.872881:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571953.897937:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788571954.726929:0:7042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788571954.927585:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788571955.825645:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788571955.825654:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c065ad2800 from 21 10000000:01000000:2.0:1788571955.825658:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788571955.825969:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571955.826046:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571955.826057:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571955.826082:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292224:0@lo:101: 00000100:00100000:2.0:1788571955.826145:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571955.826207:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788571955.840098:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518292224 00000100:00100000:1.0:1788571955.840112:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518292224 00000100:00100000:1.0:1788571955.840184:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788571955.840194:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518292224:12345-0@lo:101: 00010000:00010000:1.0:1788571955.840210:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571955.840230:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff41e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571955.840941:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff41e expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571955.840957:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff41e expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571955.840968:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2200, rc 0) 00000100:00100000:1.0:1788571955.841176:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518292224:12345-0@lo:101: Request processed in 982us (15028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571955.841184:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788571955.851548:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292224:0@lo:101: 00010000:00010000:2.0:1788571955.851696:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571955.851827:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571955.851908:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292352:0@lo:501: 00000100:00100000:2.0:1788571955.852626:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571955.853511:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788571955.863429:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518292352 00000100:00100000:0.0:1788571955.863443:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518292352 00000100:00100000:0.0:1788571955.863513:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788571955.863523:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518292352:12345-0@lo:501: 00000100:00100000:0.0:1788571955.863924:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518292352:12345-0@lo:501: Request processed in 402us (11951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571955.863933:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788571955.864014:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292352:0@lo:501: 00000100:00100000:0.0:1788571955.864081:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292480:0@lo:503: 00000100:00100000:0.0:1788571955.864134:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571955.864163:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788571955.865222:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518292480 00000100:00100000:1.0:1788571955.865234:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518292480 00000100:00100000:1.0:1788571955.865327:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788571955.865337:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518292480:12345-0@lo:503: 00000100:00100000:1.0:1788571955.865955:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518292480:12345-0@lo:503: Request processed in 618us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571955.865965:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788571955.866042:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292480:0@lo:503: 00000100:00100000:1.0:1788571955.866234:0:7078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7078:1875453518292608:0@lo:502: 00000100:00100000:1.0:1788571955.866322:0:7078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571955.866345:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518292608 00000100:00100000:1.0:1788571955.866350:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518292608 00000100:00100000:1.0:1788571955.866372:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788571955.866379:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7078:x1875453518292608:12345-0@lo:502: 00000100:00100000:1.0:1788571955.867840:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7078:x1875453518292608:12345-0@lo:502: Request processed in 1448us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571955.867855:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788571955.867924:0:7078:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788571955.867953:0:7078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7078:1875453518292608:0@lo:502: 00000100:00100000:1.0:1788571955.869173:0:7078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7078:1875453518292736:0@lo:502: 00000100:00100000:1.0:1788571955.869242:0:7078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571955.870941:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518292736 00000100:00100000:0.0:1788571955.870956:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518292736 00000100:00100000:0.0:1788571955.871039:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788571955.871049:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7078:x1875453518292736:12345-0@lo:502: 00000100:00100000:1.0:1788571955.871752:0:7078:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788571955.877876:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7078:x1875453518292736:12345-0@lo:502: Request processed in 6818us (8623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571955.877891:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788571955.878215:0:7078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7078:1875453518292736:0@lo:502: 00000040:00080000:2.0:1788571955.879931:0:7078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788571955.880182:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788571955.880205:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788571955.880216:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571955.880228:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571955.880238:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788571955.880241:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88c065ad2800 from 4 10000000:01000000:3.0:1788571955.880244:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788571955.880440:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571955.880449:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571955.880461:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571955.880494:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c556300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292864:0@lo:101: 00000100:00100000:3.0:1788571955.880790:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571955.880828:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0518b23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788571955.880987:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518292864 00000100:00100000:0.0:1788571955.880995:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518292864 00000100:00100000:0.0:1788571955.881041:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788571955.881050:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518292864:12345-0@lo:101: 00010000:00010000:0.0:1788571955.881062:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571955.881076:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff42c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.881100:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff42c expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.881110:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff42c expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.881118:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030600, rc 0) 00000100:00100000:0.0:1788571955.881161:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518292864:12345-0@lo:101: Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571955.881167:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788571955.881215:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c556300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292864:0@lo:101: 00010000:00010000:0.0:1788571955.881229:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.881285:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571955.881344:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292992:0@lo:256: 00000100:00100000:0.0:1788571955.881374:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571955.881388:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788571955.881800:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518292992 00000100:00100000:1.0:1788571955.881806:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518292992 00000100:00100000:1.0:1788571955.881837:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788571955.881844:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518292992:12345-0@lo:256: 20000000:01000000:1.0:1788571955.881867:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788571955.881883:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788571955.881886:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788571955.881961:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518292992:12345-0@lo:256: Request processed in 118us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571955.881969:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788571955.884108:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518292992:0@lo:256: 10000000:01000000:0.0:1788571955.884180:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788571955.884192:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.884203:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571955.884213:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788571955.884216:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788571955.884218:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788571955.884288:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.884297:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.884307:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571955.884330:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518293120:0@lo:101: 00000100:00100000:0.0:1788571955.884401:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571955.884434:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788571955.884458:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518293120 00000100:00100000:0.0:1788571955.884466:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518293120 00000100:00100000:0.0:1788571955.884511:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788571955.884520:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518293120:12345-0@lo:101: 00010000:00010000:0.0:1788571955.884532:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571955.884546:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff43a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.884568:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff43a expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.884578:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff43a expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.884586:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030a00, rc 0) 00000100:00100000:0.0:1788571955.884620:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518293120:12345-0@lo:101: Request processed in 101us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571955.884627:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788571955.884663:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518293120:0@lo:101: 00010000:00010000:0.0:1788571955.884673:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571955.884682:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571955.884724:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518293248:0@lo:501: 00000100:00100000:0.0:1788571955.884756:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571955.884771:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788571955.884784:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518293248 00000100:00100000:0.0:1788571955.884787:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518293248 00000100:00100000:0.0:1788571955.884806:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788571955.884812:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518293248:12345-0@lo:501: 00000100:00100000:0.0:1788571955.885061:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518293248:12345-0@lo:501: Request processed in 248us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571955.885067:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788571955.885098:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518293248:0@lo:501: 00000100:00100000:0.0:1788571955.885122:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518293376:0@lo:503: 00000100:00100000:0.0:1788571955.885160:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571955.885175:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788571955.885187:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518293376 00000100:00100000:0.0:1788571955.885190:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518293376 00000100:00100000:0.0:1788571955.885210:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788571955.885215:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518293376:12345-0@lo:503: 00000100:00100000:0.0:1788571955.900741:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518293376:12345-0@lo:503: Request processed in 15514us (15569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571955.900756:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788571955.900938:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518293376:0@lo:503: 00000100:00100000:0.0:1788571955.906094:0:7081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076236680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7081:1875453518293504:0@lo:502: 00000100:00100000:0.0:1788571955.906177:0:7081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571955.906217:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518293504 00000100:00100000:0.0:1788571955.906224:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518293504 00000100:00100000:0.0:1788571955.906292:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788571955.906313:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:7081:x1875453518293504:12345-0@lo:502: 00000100:00100000:0.0:1788571955.907885:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:7081:x1875453518293504:12345-0@lo:502: Request processed in 1566us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571955.907897:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788571955.907958:0:7081:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788571955.907982:0:7081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076236680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7081:1875453518293504:0@lo:502: 00000020:01000000:0.0:1788571955.908013:0:7081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788571955.908021:0:7081:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788571955.908028:0:7081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571955.908030:0:7081:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788571955.908036:0:7081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788571955.908040:0:7081:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:0.0:1788571955.908064:0:7081:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788571955.908067:0:7081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788571955.908082:0:7081:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88c058ee8000) 00000020:00000080:0.0:1788571955.908101:0:7081:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788571955.908107:0:7081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788571955.908180:0:7081:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788571955.908185:0:7081:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788571955.908192:0:7081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969bff44f 00010000:00080000:0.0:1788571955.908219:0:7081:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c0484ab800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:0.0:1788571955.909954:0:7081:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:2.0:1788571955.947167:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788571956.023533:0:7081:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788571956.023663:0:7081:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788571956.025168:0:7081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788571956.031996:0:7081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788571956.032067:0:7081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788571956.032129:0:7081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788571956.042388:0:7093:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788571956.042399:0:7093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788571956.044853:0:7081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788571956.044869:0:7081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788571956.044909:0:7081:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788571956.044930:0:7081:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969bff456 00000100:00080000:1.0:1788571956.044940:0:7081:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788571956.044946:0:7081:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88c0484ab800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788571956.044979:0:7081:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c04754d180 x1875453518293632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788571956.045040:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518293632:0@lo:8: 00000100:00100000:0.0:1788571956.045107:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788571956.045181:0:7081:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788571956.045225:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518293632 00000100:00100000:3.0:1788571956.045232:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518293632 00000020:01000000:1.0:1788571956.045243:0:7081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788571956.045277:0:7081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571956.045279:0:7081:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788571956.045283:0:7081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1788571956.045286:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:00000080:1.0:1788571956.045287:0:7081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571956.045288:0:7081:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788571956.045291:0:7081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788571956.045293:0:7081:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788571956.045300:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3296:x1875453518293632:12345-0@lo:8: 00010000:00080000:3.0:1788571956.045376:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1788571956.045404:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969bff45d 00002000:00100000:3.0:1788571956.045435:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88bf4530c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788571956.045439:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788571956.045444:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788571956.045495:0:7081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7081:1875453518293760:0@lo:502: 00000100:00100000:1.0:1788571956.045544:0:7081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:3.0:1788571956.045562:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788571956.045635:0:7081:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788571956.045652:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518293760 00000100:00100000:1.0:1788571956.045655:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518293760 00000100:00100000:1.0:1788571956.045684:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788571956.045689:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:7081:x1875453518293760:12345-0@lo:502: 00002000:00080000:3.0:1788571956.045693:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788571956.045713:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88bf4530f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788571956.045843:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518293888:0@lo:400: 00000100:00100000:2.0:1788571956.045876:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571956.045909:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788571956.045917:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518294016:0@lo:400: 00000100:00100000:2.0:1788571956.045942:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571956.045967:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518293888 00000100:00100000:2.0:1788571956.045970:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518293888 00000100:00100000:2.0:1788571956.045991:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518294016 00000100:00100000:2.0:1788571956.045993:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518294016 00000100:00100000:2.0:1788571956.046010:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788571956.046015:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518293888:12345-0@lo:400: 00000100:00100000:2.0:1788571956.046045:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518293888:12345-0@lo:400: Request processed in 30us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571956.046052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788571956.046065:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788571956.046077:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518294016:12345-0@lo:400: 00000100:00100000:2.0:1788571956.046102:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518294016:12345-0@lo:400: Request processed in 26us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571956.046107:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788571956.046126:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788571956.046149:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da6d80 x1875453518293888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571956.046161:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518293888:0@lo:400: 00010000:00080000:2.0:1788571956.046181:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da7800 x1875453518294016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571956.046189:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518294016:0@lo:400: 00000100:00100000:1.0:1788571956.046641:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:7081:x1875453518293760:12345-0@lo:502: Request processed in 949us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571956.046649:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788571956.046693:0:7081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7081:1875453518293760:0@lo:502: 00000020:01000000:1.0:1788571956.046715:0:7081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788571956.046721:0:7081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571956.046723:0:7081:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788571956.046727:0:7081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788571956.046835:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788571956.046851:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788571956.046860:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571956.046869:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788571956.046878:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788571956.046880:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88c04750cd40 from 1 10000000:01000000:1.0:1788571956.046883:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788571956.046907:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571956.046914:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571956.046931:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571956.046945:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518294144:0@lo:101: 00000100:00100000:1.0:1788571956.046972:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571956.046987:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788571956.047003:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518294144 00000100:00100000:1.0:1788571956.047007:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518294144 00000100:00100000:1.0:1788571956.047030:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788571956.047037:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518294144:12345-0@lo:101: 00010000:00010000:1.0:1788571956.047046:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571956.047058:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff464 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571956.047079:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff464 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571956.047090:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff464 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571956.047098:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db3a00, rc 0) 00000100:00100000:1.0:1788571956.047126:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518294144:12345-0@lo:101: Request processed in 89us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571956.047132:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788571956.047161:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518294144:0@lo:101: 00010000:00010000:1.0:1788571956.047172:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571956.047526:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571956.047654:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518294272:0@lo:501: 00000100:00100000:1.0:1788571956.047680:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571956.047703:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788571956.047718:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518294272 00000100:00100000:1.0:1788571956.047723:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518294272 00000100:00100000:1.0:1788571956.047744:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788571956.047750:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518294272:12345-0@lo:501: 00000100:00100000:1.0:1788571956.047948:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518294272:12345-0@lo:501: Request processed in 197us (266us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788571956.047955:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788571956.047990:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518294272:0@lo:501: 10000000:01000000:1.0:1788571956.048009:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788571956.048015:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571956.048023:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571956.050843:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1875453518293632:12345-0@lo:8: Request processed in 5534us (5727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571956.050858:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788571956.052651:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04754d180 x1875453518293632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788571966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571956.052666:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788571956.052676:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788571956.052684:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788571956.052695:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788571956.052699:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0484ab800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788571956.052753:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788571956.052760:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518293632:0@lo:8: 00000004:00080000:2.0:1788571956.054051:0:7093:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788571956.056037:0:7093:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 176846785924ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788571956.115941:0:7096:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788571956.115972:0:7096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7096:1875453518294528:0@lo:7: 00000100:00100000:1.0:1788571956.116039:0:7096:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571956.116084:0:7096:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788571956.116107:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518294400:0@lo:13: 00000100:00100000:1.0:1788571956.116133:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571956.116178:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518294400 00000100:00100000:1.0:1788571956.116185:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518294400 00000100:00100000:1.0:1788571956.116233:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788571956.116242:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518294400:12345-0@lo:13: 00002000:00000024:1.0:1788571956.116307:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788571956.116364:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518294400:12345-0@lo:13: Request processed in 123us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571956.116372:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788571956.116392:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788571956.116418:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04754d880 x1875453518294400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788571972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571956.116436:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518294400:0@lo:13: 00000100:00100000:0.0:1788571956.117723:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518294528 00000100:00100000:0.0:1788571956.117733:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518294528 00000100:00100000:0.0:1788571956.117814:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788571956.117826:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7096:x1875453518294528:12345-0@lo:7: 00002000:00080000:2.0:1788571956.127705:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788571956.127716:0:6681:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788571956.127825:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7096:x1875453518294528:12345-0@lo:7: Request processed in 9997us (11780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571956.127840:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788571956.128447:0:7096:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04754ce00 x1875453518294528/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788571972 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571956.128466:0:7096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7096:1875453518294528:0@lo:7: 00000004:00080000:0.0:1788571956.128481:0:7096:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788571956.128525:0:7096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7096:1875453518294656:0@lo:5: 00000100:00100000:0.0:1788571956.128567:0:7096:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571956.128611:0:7096:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571956.128630:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518294656 00000100:00100000:3.0:1788571956.128637:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518294656 00000100:00100000:3.0:1788571956.128684:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788571956.128693:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7096:x1875453518294656:12345-0@lo:5: 00002000:00080000:3.0:1788571956.128718:0:6679:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788571956.128722:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788571956.128958:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7096:x1875453518294656:12345-0@lo:5: Request processed in 265us (389us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788571956.128964:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788571956.129454:0:7096:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c076234380 x1875453518294656/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788571972 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571956.129469:0:7096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7096:1875453518294656:0@lo:5: 00000004:00080000:0.0:1788571956.129480:0:7096:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788571956.129508:0:7096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076236300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7096:1875453518294784:0@lo:700: 00000100:00100000:0.0:1788571956.129538:0:7096:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571956.129555:0:7096:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788571956.129574:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518294784 00000100:00100000:0.0:1788571956.129579:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518294784 00000100:00100000:0.0:1788571956.129622:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788571956.129642:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7096:x1875453518294784:12345-0@lo:700: 00000100:00100000:0.0:1788571956.129673:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076237800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6687:1875453518294912:0@lo:700: 00000100:00100000:0.0:1788571956.129700:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571956.129717:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788571956.129734:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518294912 00000100:00100000:0.0:1788571956.129738:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518294912 00000100:00100000:0.0:1788571956.129762:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788571956.129768:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6687:x1875453518294912:12345-0@lo:700: 00000004:00080000:2.0:1788571956.234079:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788571956.375332:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788571956.388239:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6687:x1875453518294912:12345-0@lo:700: Request processed in 258461us (258528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571956.388294:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788571956.389057:0:6687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c076237800 x1875453518294912/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788571972 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571956.389073:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076237800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6687:1875453518294912:0@lo:700: 40000000:02000000:0.0:1788571956.389086:0:6687:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788571956.469688:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7096:x1875453518294784:12345-0@lo:700: Request processed in 340039us (340140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571956.469704:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:0.0:1788571956.469753:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788571956.469763:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788571956.469805:0:7096:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c076236300 x1875453518294784/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788571972 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571956.469822:0:7096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076236300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7096:1875453518294784:0@lo:700: 00000004:02000040:0.0:1788571956.514324:0:7096:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788571956.521774:0:7096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076236300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7096:1875453518295040:0@lo:5: 00000100:00100000:0.0:1788571956.521845:0:7096:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571956.521907:0:7096:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052078300 going to sleep for 11 seconds 00000100:00100000:2.0:1788571956.522029:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518295040 00000100:00100000:2.0:1788571956.522038:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518295040 00000100:00100000:2.0:1788571956.522099:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788571956.522108:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7096:x1875453518295040:12345-0@lo:5: 00002000:00080000:3.0:1788571956.528519:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788571956.528541:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788571956.533858:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7096:x1875453518295040:12345-0@lo:5: Request processed in 11744us (12007us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788571956.533873:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788571956.533993:0:7096:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c076236300 x1875453518295040/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788571972 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571956.534015:0:7096:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788571956.534028:0:7096:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88c076236300 x1875453518295040/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788571972 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571956.534040:0:7096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076236300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7096:1875453518295040:0@lo:5: 00000004:00080000:0.0:1788571956.534053:0:7096:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788571956.990486:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571957.992743:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571959.019451:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571960.040513:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788571960.538129:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788571961.067400:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788571961.452658:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518295168:0@lo:400: 00000100:00100000:2.0:1788571961.452733:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571961.452783:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788571961.452790:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518295296:0@lo:400: 00000100:00100000:2.0:1788571961.452817:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571961.452845:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518295424:0@lo:400: 00000100:00100000:2.0:1788571961.452865:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571961.452881:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788571961.452887:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518295552:0@lo:400: 00000100:00100000:2.0:1788571961.452912:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571961.452950:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518295168 00000100:00100000:2.0:1788571961.452957:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518295168 00000100:00100000:2.0:1788571961.453003:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788571961.453012:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3297:x1875453518295168:12345-0@lo:400: 00000100:00100000:2.0:1788571961.453061:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3297:x1875453518295168:12345-0@lo:400: Request processed in 49us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571961.453068:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788571961.453098:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518295296 00000100:00100000:2.0:1788571961.453101:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518295296 00000100:00100000:2.0:1788571961.453129:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518295424 00000100:00100000:2.0:1788571961.453132:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518295424 00000100:00100000:2.0:1788571961.453158:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788571961.453163:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518295296:12345-0@lo:400: 00000100:00100000:2.0:1788571961.453192:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518295296:12345-0@lo:400: Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571961.453206:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788571961.453217:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788571961.453222:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518295424:12345-0@lo:400: 00000100:00100000:2.0:1788571961.453300:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518295424:12345-0@lo:400: Request processed in 78us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571961.453306:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788571961.453332:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788571961.453359:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da6d80 x1875453518295296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571961.453372:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518295296:0@lo:400: 00000100:00100000:2.0:1788571961.453383:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518295168:0@lo:400: 00010000:00080000:2.0:1788571961.453410:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da6300 x1875453518295424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571961.453419:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518295424:0@lo:400: 00000100:00100000:0.0:1788571961.453966:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518295552 00000100:00100000:0.0:1788571961.453974:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518295552 00000100:00100000:0.0:1788571961.454015:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788571961.454024:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518295552:12345-0@lo:400: 00000100:00100000:0.0:1788571961.454075:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518295552:12345-0@lo:400: Request processed in 53us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571961.454080:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788571961.454116:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da5c00 x1875453518295552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788571977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571961.454125:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788571961.454136:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518295552:0@lo:400: 00000100:00080000:3.0:1788571961.461558:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788571961.461880:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788571961.461907:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518295680:0@lo:13: 00000100:00100000:3.0:1788571961.461979:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571961.464393:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518295680 00000100:00100000:1.0:1788571961.464409:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518295680 00000100:00100000:1.0:1788571961.464461:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788571961.464484:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518295680:12345-0@lo:13: 00002000:00000024:1.0:1788571961.464521:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788571961.465928:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518295680:12345-0@lo:13: Request processed in 1440us (3942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571961.465941:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788571961.466422:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04754d880 x1875453518295680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788571977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788571961.466448:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518295680:0@lo:13: 00010000:00010000:3.0:1788571962.089609:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571963.112918:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571964.139559:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571965.160880:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571966.184629:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788571966.568567:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518296192:0@lo:400: 00000100:00100000:2.0:1788571966.568634:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571966.568678:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788571966.568682:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518295808:0@lo:400: 00000100:00100000:2.0:1788571966.568701:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571966.568728:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518296064:0@lo:400: 00000100:00100000:2.0:1788571966.568754:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571966.568772:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788571966.568777:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518295936:0@lo:400: 00000100:00100000:2.0:1788571966.568814:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571966.568853:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518295808 00000100:00100000:2.0:1788571966.568859:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518295808 00000100:00100000:2.0:1788571966.568894:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788571966.568900:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3297:x1875453518295808:12345-0@lo:400: 00000100:00100000:2.0:1788571966.568933:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3297:x1875453518295808:12345-0@lo:400: Request processed in 33us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571966.568938:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788571966.568961:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518296064 00000100:00100000:2.0:1788571966.568963:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518296064 00000100:00100000:2.0:1788571966.568993:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518295936 00000100:00100000:2.0:1788571966.568995:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518295936 00000100:00100000:2.0:1788571966.569005:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788571966.569008:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518296064:12345-0@lo:400: 00000100:00100000:2.0:1788571966.569030:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518296064:12345-0@lo:400: Request processed in 22us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571966.569034:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788571966.569041:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788571966.569044:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518295936:12345-0@lo:400: 00000100:00100000:2.0:1788571966.569058:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518295936:12345-0@lo:400: Request processed in 14us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571966.569062:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788571966.569098:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da7800 x1875453518295936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571966.569109:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518295936:0@lo:400: 00010000:00080000:2.0:1788571966.569115:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da6d80 x1875453518296064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571966.569126:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518296064:0@lo:400: 00000100:00100000:2.0:1788571966.569146:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518295808:0@lo:400: 00000100:00100000:3.0:1788571966.569204:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518296192 00000100:00100000:3.0:1788571966.569207:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518296192 00000100:00100000:3.0:1788571966.569277:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788571966.569285:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518296192:12345-0@lo:400: 00000100:00100000:3.0:1788571966.569312:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518296192:12345-0@lo:400: Request processed in 30us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571966.569316:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788571966.569328:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788571966.569331:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788571966.569554:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518296320:0@lo:13: 00000100:00100000:0.0:1788571966.569577:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571966.569633:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518296320 00000100:00100000:1.0:1788571966.569636:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518296320 00000100:00100000:1.0:1788571966.569660:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788571966.569665:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518296320:12345-0@lo:13: 00002000:00000024:1.0:1788571966.569692:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788571966.569728:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518296320:12345-0@lo:13: Request processed in 63us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571966.569734:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788571966.569825:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04754e300 x1875453518296320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788571982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788571966.569836:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518296320:0@lo:13: 00010000:00080000:2.0:1788571966.570106:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da5880 x1875453518296192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788571982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571966.570113:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518296192:0@lo:400: 00010000:00010000:0.0:1788571967.210014:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788571967.342362:0:7618:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788571967.342366:0:7618:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788571967.342578:0:7618:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88c07bb14000 00000020:01000004:1.0:1788571967.342594:0:7618:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788571967.342606:0:7618:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788571967.342630:0:7618:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88c04854b380) 00000020:00000080:1.0:1788571967.342647:0:7618:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788571967.359961:0:7618:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788571967.360114:0:7618:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788571967.380028:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788571967.385087:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788571967.385110:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788571967.385144:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788571967.385159:0:7618:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788571967.386030:0:7618:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788571967.386044:0:7618:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788571967.386052:0:7618:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x977d9e7969bff479 00000020:01000004:3.0:1788571967.386060:0:7618:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788571967.386079:0:7618:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788571967.386082:0:7618:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788571967.386087:0:7618:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788571967.386103:0:7618:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788571967.386106:0:7618:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788571967.406671:0:7618:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788571967.406712:0:7618:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.102@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788571967.406717:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788571967.406718:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788571967.406720:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571967.406721:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571967.406722:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571967.406723:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571967.406803:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788571967.406805:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571967.406806:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571967.406808:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571967.406809:0:7618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788571967.406813:0:7618:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788571967.406816:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788571967.406817:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788571967.406818:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571967.406819:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571967.406820:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571967.406821:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571967.406822:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788571967.406823:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571967.406824:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571967.406825:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571967.406826:0:7618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788571967.406863:0:7618:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788571967.406880:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518296448:0@lo:253: 00000100:00100000:2.0:1788571967.406961:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571967.407080:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052f8fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788571967.411577:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518296448 00000100:00100000:1.0:1788571967.411595:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518296448 00000100:00100000:1.0:1788571967.411836:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788571967.411848:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:7618:x1875453518296448:12345-0@lo:253: 20000000:01000000:1.0:1788571967.411889:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788571967.411894:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788571967.411901:0:5824:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788571967.411904:0:5824:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788571967.413091:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788571967.413343:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788571967.413358:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788571967.413400:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788571967.413408:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788571967.413438:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788571967.414680:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788571967.415157:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788571967.415179:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:1.0:1788571967.415181:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:1.0:1788571967.415238:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788571967.415370:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788571967.415424:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788571967.415433:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:1.0:1788571967.415480:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788571967.415489:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788571967.415520:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788571967.415568:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788571967.416766:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788571967.416792:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:0.0:1788571967.416794:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788571967.416844:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788571967.416852:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788571967.416883:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788571967.416890:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:0.0:1788571967.416922:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788571967.416931:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788571967.416976:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788571967.417013:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788571967.417034:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788571967.417036:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788571967.417042:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788571967.417044:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788571967.417046:0:5824:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788571967.417059:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788571967.417061:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788571967.417097:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788571967.417100:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788571967.418706:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788571967.418799:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788571967.418834:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788571967.419173:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788571967.419233:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788571967.419322:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788571967.419342:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788571967.419345:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788571967.419713:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788571967.419756:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788571967.419802:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788571967.419954:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788571967.419993:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788571967.420029:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788571967.420119:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788571967.420124:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788571967.420397:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788571967.420729:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788571967.420766:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788571967.420821:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788571967.420833:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788571967.420835:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788571967.421705:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788571967.422016:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788571967.422075:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788571967.422656:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788571967.422698:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788571967.422795:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1788571967.422817:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788571967.422835:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.422851:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff3ca expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.422858:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff3f4 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.422874:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff41e expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.422880:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff43a expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.422886:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff464 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.422893:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.422931:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff464 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.422945:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff464 expref: 16 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.422960:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518296576:0@lo:104: 00000100:00100000:0.0:1788571967.423029:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788571967.423122:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff43a expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.423129:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff43a expref: 16 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.423137:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518296704:0@lo:104: 00010000:00010000:0.0:1788571967.423160:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff41e expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.423177:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff41e expref: 16 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.423185:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076237100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518296832:0@lo:104: 00010000:00010000:0.0:1788571967.423210:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff3f4 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.423229:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff3f4 expref: 16 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.423237:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518296960:0@lo:104: 00010000:00010000:0.0:1788571967.423402:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff3ca expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.423411:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff3ca expref: 16 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.423419:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518297088:0@lo:104: 00000100:00100000:0.0:1788571967.423437:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788571967.423695:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788571967.423716:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.423807:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.423897:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.423918:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518296576 00000100:00100000:0.0:1788571967.423925:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518296576 00000100:00100000:0.0:1788571967.423960:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518296704 00000100:00100000:0.0:1788571967.423963:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518296704 00000100:00100000:0.0:1788571967.423973:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518296832 00000100:00100000:0.0:1788571967.423975:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518296832 00000100:00100000:0.0:1788571967.423988:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788571967.423995:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058efe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:5824:x1875453518296576:12345-0@lo:104: 00010000:00010000:0.0:1788571967.424009:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424120:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788571967.424126:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058efe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:5824:x1875453518296576:12345-0@lo:104: Request processed in 131us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571967.424133:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788571967.424174:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788571967.424180:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:5824:x1875453518296704:12345-0@lo:104: 00010000:00010000:0.0:1788571967.424187:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424230:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788571967.424235:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:5824:x1875453518296704:12345-0@lo:104: Request processed in 57us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571967.424242:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788571967.424278:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788571967.424284:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5824:x1875453518296832:12345-0@lo:104: 00010000:00010000:0.0:1788571967.424292:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424319:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788571967.424323:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5824:x1875453518296832:12345-0@lo:104: Request processed in 40us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571967.424330:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788571967.424346:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788571967.424352:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424359:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db2c00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788571967.424369:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424378:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788571967.424385:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571967.424391:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788571967.424425:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424430:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788571967.424540:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788571967.424624:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.424642:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518296960 00000100:00100000:1.0:1788571967.424645:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518296960 00000100:00100000:1.0:1788571967.424664:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518297088 00000100:00100000:1.0:1788571967.424667:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518297088 00000100:00100000:1.0:1788571967.424677:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788571967.424683:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:5824:x1875453518296960:12345-0@lo:104: 00010000:00010000:1.0:1788571967.424692:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.424721:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788571967.424732:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:5824:x1875453518296960:12345-0@lo:104: Request processed in 44us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571967.424738:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788571967.424752:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788571967.424757:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5824:x1875453518297088:12345-0@lo:104: 00010000:00010000:1.0:1788571967.424765:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.424789:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788571967.424794:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5824:x1875453518297088:12345-0@lo:104: Request processed in 38us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571967.424800:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788571967.424877:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424885:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c046db2c00/0x977d9e7969bff464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff46b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424898:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788571967.424900:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424905:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041522a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788571967.424908:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424914:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788571967.424931:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571967.424936:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788571967.424951:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424957:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788571967.424962:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424969:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff41e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff425 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424979:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788571967.424982:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424987:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040030000 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788571967.424990:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.424996:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788571967.425002:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571967.425007:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788571967.425027:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.425033:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788571967.425057:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.425063:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040030000/0x977d9e7969bff3f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff3fb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.425073:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788571967.425075:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.425081:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040031000 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788571967.425084:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.425091:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788571967.425098:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571967.425103:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788571967.425126:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.425132:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788571967.425137:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.425151:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040031000/0x977d9e7969bff3ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff3d1 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.425160:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571967.425161:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571967.425163:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788571967.425184:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518297216:0@lo:103: 00000100:00100000:0.0:1788571967.425225:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.425284:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788571967.425290:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518297344:0@lo:103: 00000100:00100000:0.0:1788571967.425309:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.425334:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518297600:0@lo:103: 00000100:00100000:0.0:1788571967.425351:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.425362:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788571967.425366:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518297472:0@lo:103: 00000100:00100000:0.0:1788571967.425379:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.425396:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518297216 00000100:00100000:0.0:1788571967.425399:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518297216 00010000:00010000:0.0:1788571967.425417:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff464 expref: 17 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.425431:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518297344 00000100:00100000:0.0:1788571967.425433:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518297344 00000100:00100000:1.0:1788571967.425748:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518297600 00000100:00100000:1.0:1788571967.425753:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518297600 00010000:00010000:1.0:1788571967.425769:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff3ca expref: 19 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571967.425782:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518297472 00000100:00100000:1.0:1788571967.425784:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518297472 00010000:00010000:1.0:1788571967.425792:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff3f4 expref: 20 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571967.425815:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788571967.425823:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+20:3299:x1875453518297216:12345-0@lo:103: 00010000:00010000:1.0:1788571967.425836:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788571967.425841:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff464 expref: 20 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.425851:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff464 expref: 20 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.425869:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788571967.425913:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+20:3299:x1875453518297216:12345-0@lo:103: Request processed in 91us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571967.425919:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788571967.425934:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788571967.425940:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518297600:12345-0@lo:103: 00010000:00010000:1.0:1788571967.425947:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788571967.425951:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff3ca expref: 19 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.425960:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff3ca expref: 19 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.425969:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788571967.425995:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518297600:12345-0@lo:103: Request processed in 55us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571967.426001:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788571967.426012:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788571967.426026:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3298:x1875453518297472:12345-0@lo:103: 00010000:00010000:1.0:1788571967.426033:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788571967.426037:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff3f4 expref: 18 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.426045:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff3f4 expref: 18 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.426053:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788571967.426076:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3298:x1875453518297472:12345-0@lo:103: Request processed in 51us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571967.426081:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788571967.426117:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518297472:0@lo:103: 00000100:00100000:1.0:1788571967.426126:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518297600:0@lo:103: 00000100:00100000:3.0:1788571967.426201:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518297216:0@lo:103: 00010000:00010000:0.0:1788571967.426581:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff41e expref: 18 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.426609:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788571967.426617:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3299:x1875453518297344:12345-0@lo:103: 00010000:00010000:0.0:1788571967.426631:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788571967.426637:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff41e expref: 17 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.426644:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff41e expref: 17 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.426651:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788571967.426746:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3299:x1875453518297344:12345-0@lo:103: Request processed in 131us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571967.426753:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788571967.427426:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571967.427430:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571967.427432:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571967.427524:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427535:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040030400 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788571967.427539:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427549:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788571967.427555:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571967.427561:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788571967.427603:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427609:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788571967.427627:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427642:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff43a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff441 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427660:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571967.427661:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571967.427663:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788571967.427671:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788571967.427688:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518297728:0@lo:103: 00000100:00100000:0.0:1788571967.427745:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.427791:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518297728 00000100:00100000:0.0:1788571967.427796:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518297728 00010000:00010000:0.0:1788571967.427817:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff43a expref: 17 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.427839:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788571967.427847:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3300:x1875453518297728:12345-0@lo:103: 00010000:00010000:0.0:1788571967.427856:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788571967.427860:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff43a expref: 17 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427870:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff43a expref: 17 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427884:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427893:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427917:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427925:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427931:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427938:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427942:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788571967.427946:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427952:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427960:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.427969:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788571967.428001:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3300:x1875453518297728:12345-0@lo:103: Request processed in 155us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571967.428007:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788571967.428039:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518297728:0@lo:103: 00010000:00010000:2.0:1788571967.428198:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff46b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff464 expref: 16 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571967.428210:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518296576:0@lo:104: 00010000:00010000:2.0:1788571967.428233:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030a00/0x977d9e7969bff441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff43a expref: 15 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571967.428243:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518296704:0@lo:104: 00010000:00010000:2.0:1788571967.428272:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff41e expref: 14 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571967.428283:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076237100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518296832:0@lo:104: 00010000:00010000:2.0:1788571967.428294:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3800/0x977d9e7969bff3fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff3f4 expref: 13 pid: 5823 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571967.428301:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518296960:0@lo:104: 00010000:00010000:2.0:1788571967.428313:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030200/0x977d9e7969bff3d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff3ca expref: 12 pid: 5825 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571967.428320:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5824:1875453518297088:0@lo:104: 00010000:00010000:2.0:1788571967.428340:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571967.428349:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571967.428362:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571967.428368:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff480 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788571967.428380:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788571967.429641:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518297344:0@lo:103: 00000100:00100000:3.0:1788571967.474851:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:7618:x1875453518296448:12345-0@lo:253: Request processed in 62995us (67880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.474866:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788571967.474974:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518296448:0@lo:253: 10000000:01000000:2.0:1788571967.474991:0:7618:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788571967.474994:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788571967.474996:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788571967.474998:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571967.474999:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788571967.475000:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571967.475002:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571967.475003:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788571967.475004:0:7618:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788571967.475006:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571967.475007:0:7618:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788571967.475030:0:7618:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88c07bb14000 from lustre-OST0001 10000000:01000000:2.0:1788571967.475056:0:7618:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788571967.475059:0:7618:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788571967.475067:0:7618:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88c04750cd40 local copy 10000000:01000000:2.0:1788571967.475071:0:7618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788571967.475108:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571967.475118:0:7618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571967.475128:0:7618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571967.475165:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518297856:0@lo:101: 00000100:00100000:2.0:1788571967.475202:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571967.475285:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.475365:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518297856 00000100:00100000:3.0:1788571967.475371:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518297856 00000100:00100000:3.0:1788571967.475411:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788571967.475420:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+11:7618:x1875453518297856:12345-0@lo:101: 00010000:00010000:3.0:1788571967.475432:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571967.475453:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387200/0x977d9e7969bff48e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff487 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.475478:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387200/0x977d9e7969bff48e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff487 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.475489:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387200/0x977d9e7969bff48e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff487 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.475499:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387200, rc 0) 00000100:00100000:3.0:1788571967.475545:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:7618:x1875453518297856:12345-0@lo:101: Request processed in 127us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.475551:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788571967.475690:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518297856:0@lo:101: 00010000:00010000:1.0:1788571967.475702:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.475711:0:7618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571967.475814:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518297984:0@lo:501: 00000100:00100000:1.0:1788571967.475841:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.475868:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c067665300 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.476235:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518297984 00000100:00100000:3.0:1788571967.476240:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518297984 00000100:00100000:3.0:1788571967.476297:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788571967.476304:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:7618:x1875453518297984:12345-0@lo:501: 00000100:00100000:3.0:1788571967.476523:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:7618:x1875453518297984:12345-0@lo:501: Request processed in 219us (680us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788571967.476530:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788571967.476568:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518297984:0@lo:501: 10000000:01000000:3.0:1788571967.476582:0:7618:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788571967.476607:0:7618:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788571967.476613:0:7618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.476622:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.476630:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.476649:0:7618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788571967.476668:0:7618:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88c07bb14000 10000000:01000000:3.0:1788571967.476673:0:7618:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788571967.476677:0:7618:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788571967.476679:0:7618:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788571967.476684:0:7618:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788571967.476693:0:7618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788571967.476712:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.476720:0:7618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.476728:0:7618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571967.476742:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298112:0@lo:101: 00000100:00100000:3.0:1788571967.476770:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571967.476792:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076bc80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.476805:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518298112 00000100:00100000:3.0:1788571967.476808:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518298112 00000100:00100000:3.0:1788571967.476825:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788571967.476831:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:7618:x1875453518298112:12345-0@lo:101: 00010000:00010000:3.0:1788571967.476838:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571967.476847:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff495 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.476863:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff495 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.476871:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff495 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.476879:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386c00, rc 0) 00000100:00100000:3.0:1788571967.476911:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298112:12345-0@lo:101: Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.476926:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788571967.476958:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298112:0@lo:101: 00010000:00010000:3.0:1788571967.476968:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.476976:0:7618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571967.477029:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298240:0@lo:501: 00000100:00100000:3.0:1788571967.477051:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571967.477065:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076bc80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.477077:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518298240 00000100:00100000:3.0:1788571967.477080:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518298240 00000100:00100000:3.0:1788571967.477095:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788571967.477100:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298240:12345-0@lo:501: 00000100:00100000:3.0:1788571967.477285:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298240:12345-0@lo:501: Request processed in 183us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.477292:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788571967.477322:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298240:0@lo:501: 00000100:00100000:3.0:1788571967.477345:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298368:0@lo:503: 00000100:00100000:3.0:1788571967.477382:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571967.477399:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076bc80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.477411:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518298368 00000100:00100000:3.0:1788571967.477414:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518298368 00000100:00100000:3.0:1788571967.477430:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788571967.477435:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298368:12345-0@lo:503: 00000100:00100000:3.0:1788571967.477568:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298368:12345-0@lo:503: Request processed in 132us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.477575:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788571967.477613:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298368:0@lo:503: 00000040:00080000:3.0:1788571967.477854:0:7618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788571967.477903:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298496:0@lo:502: 00000100:00100000:3.0:1788571967.477935:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571967.477949:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076bc80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.477962:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518298496 00000100:00100000:3.0:1788571967.477965:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518298496 00000100:00100000:3.0:1788571967.477982:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788571967.477987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298496:12345-0@lo:502: 00000100:00100000:3.0:1788571967.478104:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298496:12345-0@lo:502: Request processed in 116us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.478110:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788571967.478146:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298496:0@lo:502: 00000040:00080000:3.0:1788571967.478427:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788571967.478472:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788571967.478508:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788571967.478555:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788571967.478593:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788571967.478623:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788571967.478643:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298624:0@lo:502: 00000100:00100000:3.0:1788571967.478679:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571967.478703:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076bc80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.478718:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518298624 00000100:00100000:3.0:1788571967.478721:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518298624 00000100:00100000:3.0:1788571967.478748:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788571967.478754:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298624:12345-0@lo:502: 00000100:00100000:3.0:1788571967.478867:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298624:12345-0@lo:502: Request processed in 113us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.478873:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788571967.478912:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298624:0@lo:502: 00000040:00080000:3.0:1788571967.478979:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788571967.478989:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:1.0:1788571967.479476:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788571967.479490:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.479500:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041522600 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:1.0:1788571967.479504:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.479512:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788571967.479519:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788571967.479524:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788571967.479547:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.479553:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788571967.479570:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.479578:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041522600/0x977d9e7969bff487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x977d9e7969bff48e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.479591:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571967.479593:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571967.479595:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571967.479606:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518298752:0@lo:103: 00000100:00100000:1.0:1788571967.479639:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.479684:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518298752 00000100:00100000:1.0:1788571967.479689:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518298752 00000100:00100000:1.0:1788571967.479726:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788571967.479734:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:3300:x1875453518298752:12345-0@lo:103: 00010000:00010000:1.0:1788571967.479746:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788571967.479761:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387200/0x977d9e7969bff48e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff487 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.479772:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788571967.479799:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:3300:x1875453518298752:12345-0@lo:103: Request processed in 66us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571967.479805:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788571967.479833:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518298752:0@lo:103: 00000020:01000000:2.0:1788571967.480241:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788571967.480417:0:7625:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788571967.480425:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788571967.480427:0:7625:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788571967.480434:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788571967.480522:0:7625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88c0760a0000) 00000020:00000080:2.0:1788571967.480548:0:7625:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788571967.480555:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788571967.480632:0:7625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88c07bb14000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788571967.480640:0:7625:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788571967.480648:0:7625:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x977d9e7969bff4aa 00010000:00010000:2.0:1788571967.485994:0:7625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788571967.486945:0:7625:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788571967.489999:0:7625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788571967.490762:0:7625:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788571967.495955:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788571967.496546:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788571967.498369:0:7625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788571967.498381:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788571967.498387:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571967.498389:0:7625:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788571967.498393:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788571967.498396:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571967.498398:0:7625:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788571967.498400:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788571967.498402:0:7625:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788571967.498657:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788571967.498661:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571967.498662:0:7625:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788571967.498666:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788571967.506829:0:7618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788571967.506874:0:7618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788571967.506911:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.506926:0:7618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571967.507360:0:7618:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c07bb14000 from 1 10000000:01000000:0.0:1788571967.507364:0:7618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788571967.507405:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.507414:0:7618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.507425:0:7618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.507663:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298880:0@lo:101: 00000100:00100000:0.0:1788571967.507798:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.508425:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788571967.511234:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518298880 00000100:00100000:2.0:1788571967.511377:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518298880 00000100:00100000:3.0:1788571967.511696:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788571967.511717:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:7618:x1875453518298880:12345-0@lo:101: 00010000:00010000:3.0:1788571967.511734:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571967.511752:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff4b1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.511780:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff4b1 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.511793:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff4b1 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.511802:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387600, rc 0) 00000100:00100000:3.0:1788571967.511878:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518298880:12345-0@lo:101: Request processed in 172us (4080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.511900:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788571967.511989:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518298880:0@lo:101: 00010000:00010000:0.0:1788571967.512008:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.512017:0:7618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.512126:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299008:0@lo:501: 00000100:00100000:0.0:1788571967.512161:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.512569:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788571967.512724:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518299008 00000100:00100000:1.0:1788571967.512731:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518299008 00000100:00100000:2.0:1788571967.512781:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788571967.512791:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518299008:12345-0@lo:501: 00000100:00100000:2.0:1788571967.513035:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518299008:12345-0@lo:501: Request processed in 245us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571967.513042:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788571967.513173:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299008:0@lo:501: 00000100:00100000:0.0:1788571967.513208:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299136:0@lo:503: 00000100:00100000:0.0:1788571967.513288:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.513306:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788571967.513418:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518299136 00000100:00100000:2.0:1788571967.513423:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518299136 00000100:00100000:2.0:1788571967.513451:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788571967.513457:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518299136:12345-0@lo:503: 00000100:00100000:2.0:1788571967.513925:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518299136:12345-0@lo:503: Request processed in 466us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571967.513941:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788571967.514033:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299136:0@lo:503: 00000040:00080000:0.0:1788571967.514367:0:7618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788571967.514431:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299264:0@lo:502: 00000100:00100000:0.0:1788571967.514649:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.514679:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.514812:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518299264 00000100:00100000:3.0:1788571967.514818:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518299264 00000100:00100000:3.0:1788571967.514846:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788571967.514854:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518299264:12345-0@lo:502: 00000100:00100000:3.0:1788571967.515018:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518299264:12345-0@lo:502: Request processed in 164us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.515026:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788571967.515157:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299264:0@lo:502: 00000040:00080000:0.0:1788571967.515671:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788571967.515802:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788571967.515835:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299392:0@lo:502: 00000100:00100000:0.0:1788571967.515880:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.515915:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.516013:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518299392 00000100:00100000:3.0:1788571967.516019:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518299392 00000100:00100000:3.0:1788571967.516058:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788571967.516068:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518299392:12345-0@lo:502: 00000100:00100000:3.0:1788571967.516228:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518299392:12345-0@lo:502: Request processed in 152us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.516234:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788571967.516371:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299392:0@lo:502: 00000040:00080000:3.0:1788571967.516770:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788571967.516785:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788571967.518180:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788571967.518204:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788571967.518206:0:7629:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788571967.518213:0:7629:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c07bb14000 00000020:00000080:3.0:1788571967.518228:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788571967.518422:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788571967.518428:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788571967.518429:0:7629:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788571967.518432:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788571967.518784:0:7618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788571967.518810:0:7618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788571967.518875:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.518887:0:7618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788571967.518934:0:7618:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788571967.518936:0:7618:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88c07bb14000 10000000:01000000:0.0:1788571967.518939:0:7618:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88c07bb14000 10000000:01000000:0.0:1788571967.518950:0:7618:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788571967.518955:0:7618:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c07bb14000 from 1 10000000:01000000:0.0:1788571967.518958:0:7618:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788571967.518992:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.519001:0:7618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.519010:0:7618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.519031:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299520:0@lo:101: 00000100:00100000:0.0:1788571967.519093:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.519139:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.519198:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518299520 00000100:00100000:3.0:1788571967.519212:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518299520 00000100:00100000:3.0:1788571967.519348:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788571967.519359:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518299520:12345-0@lo:101: 00010000:00010000:3.0:1788571967.519372:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571967.519387:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff4bf expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.519412:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff4bf expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.519423:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff4bf expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571967.519432:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387000, rc 0) 00000100:00100000:3.0:1788571967.519619:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518299520:12345-0@lo:101: Request processed in 262us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.519626:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788571967.519779:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299520:0@lo:101: 00010000:00010000:0.0:1788571967.519794:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.519803:0:7618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.519896:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299648:0@lo:501: 00000100:00100000:0.0:1788571967.519922:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.519950:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.519994:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518299648 00000100:00100000:3.0:1788571967.519998:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518299648 00000100:00100000:3.0:1788571967.520029:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788571967.520037:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518299648:12345-0@lo:501: 00000100:00100000:3.0:1788571967.520412:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518299648:12345-0@lo:501: Request processed in 375us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.520419:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788571967.520679:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299648:0@lo:501: 00000100:00100000:0.0:1788571967.520787:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299776:0@lo:503: 00000100:00100000:0.0:1788571967.520827:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.520865:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.520907:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518299776 00000100:00100000:3.0:1788571967.520912:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518299776 00000100:00100000:3.0:1788571967.520943:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788571967.520950:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518299776:12345-0@lo:503: 00000100:00100000:3.0:1788571967.521146:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518299776:12345-0@lo:503: Request processed in 196us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.521158:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788571967.522059:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299776:0@lo:503: 00000040:00080000:1.0:1788571967.522635:0:7618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788571967.522769:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299904:0@lo:502: 00000100:00100000:1.0:1788571967.522833:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.522914:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c067665540 going to sleep for 11 seconds 00000100:00100000:3.0:1788571967.522952:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518299904 00000100:00100000:3.0:1788571967.522958:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518299904 00000100:00100000:3.0:1788571967.523037:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788571967.523047:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518299904:12345-0@lo:502: 00000100:00100000:3.0:1788571967.523385:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518299904:12345-0@lo:502: Request processed in 339us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.523392:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788571967.523614:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518299904:0@lo:502: 00000040:00080000:1.0:1788571967.523947:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788571967.523999:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788571967.524034:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788571967.524076:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788571967.524109:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788571967.524164:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788571967.524199:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788571967.524242:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788571967.524593:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788571967.524635:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788571967.524669:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788571967.524903:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788571967.524943:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788571967.524976:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788571967.525020:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788571967.525055:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788571967.525086:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788571967.525133:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788571967.525170:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788571967.525204:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788571967.525616:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788571967.525657:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788571967.525692:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788571967.526016:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788571967.526071:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788571967.526109:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788571967.526160:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788571967.526211:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788571967.526504:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788571967.526799:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788571967.526848:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788571967.526882:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788571967.526914:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788571967.526962:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788571967.526997:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788571967.527045:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788571967.527079:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788571967.527128:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518300032:0@lo:502: 00000100:00100000:1.0:1788571967.527205:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.527426:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c067665540 going to sleep for 11 seconds 00000100:00100000:0.0:1788571967.527795:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518300032 00000100:00100000:0.0:1788571967.527803:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518300032 00000100:00100000:0.0:1788571967.527951:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788571967.527962:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518300032:12345-0@lo:502: 00000100:00100000:0.0:1788571967.528188:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518300032:12345-0@lo:502: Request processed in 229us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571967.528196:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788571967.528324:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518300032:0@lo:502: 00000040:00080000:1.0:1788571967.528402:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788571967.528413:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788571967.529386:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788571967.529401:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88c048548000) 00000020:00000080:1.0:1788571967.529423:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788571967.529700:0:7630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88c07bb14000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788571967.529704:0:7630:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c07bb14000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788571967.529707:0:7630:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c07bb14000 3 00010000:00080000:1.0:1788571967.529736:0:7630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c0513c7800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1788571967.533169:0:7630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788571967.533754:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788571967.533792:0:7630:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788571967.533804:0:7630:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x977d9e7969bff4d4 00000100:00080000:1.0:1788571967.533814:0:7630:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788571967.533820:0:7630:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88c0513c7800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788571967.533852:0:7630:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c04754e680 x1875453518300160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788571967.533868:0:7630:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1788571967.534097:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1788571967.534238:0:7631:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff88c04754d880 x1875453518300288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571967.534416:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518300416:0@lo:400: 00000100:00100000:2.0:1788571967.534612:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571967.534649:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788571967.534655:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518300544:0@lo:400: 00000100:00100000:2.0:1788571967.534677:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571967.534702:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788571967.534710:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518300672:0@lo:400: 00000100:00100000:2.0:1788571967.534737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571967.534767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518300416 00000100:00100000:2.0:1788571967.534774:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518300416 00000100:00100000:2.0:1788571967.534807:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518300544 00000100:00100000:2.0:1788571967.534809:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518300544 00000100:00100000:2.0:1788571967.534825:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788571967.534832:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518300416:12345-0@lo:400: 00000100:00100000:2.0:1788571967.534879:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518300416:12345-0@lo:400: Request processed in 48us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571967.534886:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788571967.534901:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788571967.534907:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518300544:12345-0@lo:400: 00000100:00100000:2.0:1788571967.534933:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518300544:12345-0@lo:400: Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571967.534938:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788571967.534959:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518300672 00000100:00100000:2.0:1788571967.534963:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518300672 00000100:00100000:2.0:1788571967.534985:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788571967.534991:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518300672:12345-0@lo:400: 00000100:00100000:2.0:1788571967.535030:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518300672:12345-0@lo:400: Request processed in 39us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571967.535036:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788571967.535069:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da7800 x1875453518300672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788571983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571967.535081:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518300672:0@lo:400: 00010000:00080000:2.0:1788571967.535106:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da6d80 x1875453518300544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571967.535114:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518300544:0@lo:400: 00010000:00080000:2.0:1788571967.535122:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c075da6300 x1875453518300416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571967.535129:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518300416:0@lo:400: 00000020:01000000:2.0:1788571967.535148:0:7618:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788571967.535177:0:7618:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788571967.535192:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571967.535203:0:7618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.535359:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518300160:0@lo:38: 00000100:00100000:0.0:1788571967.535395:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.535622:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c067665c00 going to sleep for 0 seconds 00000100:00100000:0.0:1788571967.535694:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518300160 00000100:00100000:0.0:1788571967.535699:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518300160 00000100:00100000:0.0:1788571967.535729:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788571967.535734:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1875453518300160:12345-0@lo:38: 00010000:00080000:0.0:1788571967.535754:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:0.0:1788571967.535787:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x977d9e7969bff4db 00000004:00100000:0.0:1788571967.535802:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788571967.535834:0:5832:0:(import.c:65:import_set_state_nolock()) ffff88c07f74e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788571967.535877:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875453518300160:12345-0@lo:38: Request processed in 142us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571967.535884:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788571967.535915:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04754e680 x1875453518300160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788571977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571967.535924:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788571967.535931:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788571967.535937:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788571967.535941:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788571967.535953:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0513c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788571967.535959:0:3296:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000007eaec3c): req@ffff88c04754d880 x1875453518300288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571967.535972:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518300160:0@lo:38: 00000100:00100000:1.0:1788571967.536063:0:7631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.536086:0:7631:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c067665c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788571967.536135:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518300288 00000100:00100000:0.0:1788571967.536139:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518300288 00000100:00100000:0.0:1788571967.536183:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788571967.536190:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7631:x1875453518300288:12345-0@lo:901: 00000100:00100000:0.0:1788571967.537965:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7631:x1875453518300288:12345-0@lo:901: Request processed in 1771us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571967.537977:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:2.0:1788571967.538041:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788571967.538044:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788571967.538046:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571967.538047:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571967.538048:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571967.538049:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571967.538051:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788571967.538052:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571967.538060:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571967.538061:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571967.538062:0:7618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788571967.538067:0:7618:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788571967.538069:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788571967.538071:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788571967.538071:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571967.538072:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571967.538073:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571967.538074:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571967.538075:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788571967.538076:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571967.538077:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571967.538078:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571967.538078:0:7618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788571967.538101:0:7618:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788571967.538115:0:7618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518300800:0@lo:253: 00000100:00100000:2.0:1788571967.538158:0:7618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571967.538189:0:7618:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047571780 going to sleep for 11 seconds 00000100:00080000:1.0:1788571967.538309:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788571967.538355:0:7631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c04754d880 x1875453518300288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788571983 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571967.538368:0:7631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7631:1875453518300288:0@lo:901: 00000100:00100000:0.0:1788571967.538751:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518300800 00000100:00100000:0.0:1788571967.538757:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518300800 00000100:00100000:0.0:1788571967.538802:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788571967.538811:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:7618:x1875453518300800:12345-0@lo:253: 20000000:01000000:0.0:1788571967.538850:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788571967.538864:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788571967.571842:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788571967.571858:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788571967.571878:0:5846:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788571967.571882:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788571967.571907:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.571926:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff42c expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.571934:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.571990:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff42c expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571967.572002:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff42c expref: 14 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571967.572016:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1875453518300928:0@lo:104: 00000100:00100000:0.0:1788571967.572077:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571967.572117:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788571967.572282:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518300928 00000100:00100000:1.0:1788571967.572290:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518300928 00000100:00100000:1.0:1788571967.572337:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788571967.572347:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5846:x1875453518300928:12345-0@lo:104: 00010000:00010000:1.0:1788571967.572361:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572413:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788571967.572419:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:5846:x1875453518300928:12345-0@lo:104: Request processed in 74us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571967.572425:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788571967.572457:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788571967.572463:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572470:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:1.0:1788571967.572474:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572493:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788571967.572500:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788571967.572505:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788571967.572606:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572613:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788571967.572632:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572639:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387a00/0x977d9e7969bff42c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff433 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572655:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571967.572657:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571967.572658:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571967.572677:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518301056:0@lo:103: 00000100:00100000:1.0:1788571967.572710:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571967.572746:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518301056 00000100:00100000:1.0:1788571967.572750:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518301056 00010000:00010000:1.0:1788571967.572766:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff42c expref: 15 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571967.572787:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788571967.572792:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058e7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:3300:x1875453518301056:12345-0@lo:103: 00010000:00010000:1.0:1788571967.572810:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788571967.572815:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff42c expref: 15 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572824:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff42c expref: 15 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572839:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572847:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788571967.572860:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010190729s 00010000:00010000:1.0:1788571967.572865:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572872:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572878:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572885:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572890:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788571967.572895:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572902:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572917:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.572927:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788571967.572955:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058e7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:3300:x1875453518301056:12345-0@lo:103: Request processed in 163us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571967.572961:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788571967.573021:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518301056:0@lo:103: 00010000:00010000:1.0:1788571967.573048:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030600/0x977d9e7969bff433 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff42c expref: 14 pid: 5824 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571967.573057:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5846:1875453518300928:0@lo:104: 00010000:00010000:1.0:1788571967.573069:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.573076:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.573082:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571967.573087:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff4e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571967.579819:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:7618:x1875453518300800:12345-0@lo:253: Request processed in 41000us (41649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571967.579834:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788571967.579926:0:7618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07b09b9b-dc48-4957-bfb2-5dac95d9db69:7618:1875453518300800:0@lo:253: 10000000:01000000:2.0:1788571967.579943:0:7618:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788571967.579947:0:7618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788571967.579948:0:7618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788571967.579950:0:7618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788571967.579951:0:7618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788571967.579952:0:7618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788571967.579954:0:7618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788571967.579955:0:7618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788571967.579956:0:7618:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788571967.579958:0:7618:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788571967.579959:0:7618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788571967.579961:0:7618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788571967.579978:0:7618:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788571967.586102:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788571967.586822:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788571967.587028:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788571967.587226:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788571967.587666:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788571967.587952:0:7618:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788571967.589886:0:7618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788571967.867691:0:7618:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788571967.867699:0:7618:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788571967.867734:0:7618:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788571967.867793:0:7618:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788571967.867808:0:7618:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788571967.867843:0:7618:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788571968.232674:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571969.267830:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571970.281945:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571971.304526:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788571971.696059:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788571971.696086:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518301184:0@lo:13: 00000100:00100000:0.0:1788571971.696159:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571971.696317:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518301184 00000100:00100000:1.0:1788571971.696326:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518301184 00000100:00100000:1.0:1788571971.696396:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788571971.696407:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518301184:12345-0@lo:13: 00002000:00000024:1.0:1788571971.696452:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788571971.696512:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518301184:12345-0@lo:13: Request processed in 109us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571971.696519:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788571971.696577:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c04754d880 x1875453518301184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788571987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571971.696596:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518301184:0@lo:13: 00000100:00080000:0.0:1788571971.696786:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788571972.328492:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571972.713336:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518301696:0@lo:400: 00000100:00100000:1.0:1788571972.713421:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571972.713476:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788571972.713482:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518301312:0@lo:400: 00000100:00100000:1.0:1788571972.713508:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571972.713536:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518301824:0@lo:400: 00000100:00100000:1.0:1788571972.713557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571972.713581:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518301440:0@lo:400: 00000100:00100000:1.0:1788571972.713601:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571972.713617:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788571972.713622:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518301568:0@lo:400: 00000100:00100000:1.0:1788571972.713646:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571972.713690:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518301696 00000100:00100000:1.0:1788571972.713697:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518301696 00000100:00100000:1.0:1788571972.713754:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788571972.713763:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518301696:12345-0@lo:400: 00000100:00100000:1.0:1788571972.713811:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518301696:12345-0@lo:400: Request processed in 49us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571972.713818:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788571972.713841:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518301824 00000100:00100000:1.0:1788571972.713845:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518301824 00000100:00100000:1.0:1788571972.713875:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518301440 00000100:00100000:1.0:1788571972.713878:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518301440 00000100:00100000:1.0:1788571972.713888:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518301568 00000100:00100000:1.0:1788571972.713890:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518301568 00000100:00100000:1.0:1788571972.713902:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788571972.713907:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518301824:12345-0@lo:400: 00000100:00100000:1.0:1788571972.713936:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518301824:12345-0@lo:400: Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571972.713942:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788571972.713953:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788571972.713959:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518301440:12345-0@lo:400: 00000100:00100000:1.0:1788571972.713988:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518301440:12345-0@lo:400: Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571972.713993:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788571972.714002:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788571972.714020:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518301568:12345-0@lo:400: 00000100:00100000:1.0:1788571972.714043:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518301568:12345-0@lo:400: Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571972.714048:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788571972.714078:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788571972.714427:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c04754d180 x1875453518301568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571972.714442:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518301568:0@lo:400: 00010000:00080000:1.0:1788571972.714453:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c04754e300 x1875453518301440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571972.714460:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518301440:0@lo:400: 00010000:00080000:1.0:1788571972.714617:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c04754f100 x1875453518301824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571972.714627:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518301824:0@lo:400: 00010000:00080000:1.0:1788571972.714638:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c04754dc00 x1875453518301696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788571988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571972.714646:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518301696:0@lo:400: 00000100:00100000:0.0:1788571972.715759:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518301312 00000100:00100000:0.0:1788571972.715774:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518301312 00000100:00100000:0.0:1788571972.715872:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788571972.715883:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:3297:x1875453518301312:12345-0@lo:400: 00000100:00100000:0.0:1788571972.715961:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:3297:x1875453518301312:12345-0@lo:400: Request processed in 81us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571972.715968:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788571972.716205:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518301312:0@lo:400: 00010000:00010000:1.0:1788571973.352585:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571974.376480:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788571974.788836:0:7974:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788571975.402729:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788571975.788207:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788571975.788216:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c0503c8800 from 30 10000000:01000000:0.0:1788571975.788222:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788571975.788288:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571975.788300:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571975.788322:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571975.788416:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518301952:0@lo:101: 00000100:00100000:0.0:1788571975.788487:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571975.788546:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788571975.788630:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518301952 00000100:00100000:2.0:1788571975.788639:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518301952 00000100:00100000:2.0:1788571975.788697:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788571975.788707:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518301952:12345-0@lo:101: 00010000:00010000:2.0:1788571975.788721:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788571975.788735:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff4e9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.788758:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff4e9 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.788769:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff4e9 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.788778:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041522800, rc 0) 00000100:00100000:2.0:1788571975.788819:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518301952:12345-0@lo:101: Request processed in 113us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.788825:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788571975.789186:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518301952:0@lo:101: 00010000:00010000:0.0:1788571975.789201:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571975.789210:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571975.789300:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302080:0@lo:501: 00000100:00100000:0.0:1788571975.789330:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.789450:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518302080 00000100:00100000:2.0:1788571975.789456:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518302080 00000100:00100000:2.0:1788571975.789480:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788571975.789487:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518302080:12345-0@lo:501: 00000100:00100000:2.0:1788571975.789826:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518302080:12345-0@lo:501: Request processed in 339us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.789843:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788571975.790191:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788571975.790208:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302080:0@lo:501: 00000100:00100000:0.0:1788571975.790240:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302208:0@lo:503: 00000100:00100000:0.0:1788571975.790309:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571975.790336:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788571975.791528:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518302208 00000100:00100000:2.0:1788571975.791541:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518302208 00000100:00100000:2.0:1788571975.791594:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788571975.791603:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518302208:12345-0@lo:503: 00000100:00100000:2.0:1788571975.791964:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518302208:12345-0@lo:503: Request processed in 361us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.791972:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788571975.792167:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302208:0@lo:503: 00000100:00100000:1.0:1788571975.800001:0:8028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8028:1875453518302336:0@lo:502: 00000100:00100000:1.0:1788571975.800103:0:8028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.800237:0:8028:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593bae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788571975.805193:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518302336 00000100:00100000:2.0:1788571975.805211:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518302336 00000100:00100000:2.0:1788571975.805293:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788571975.805305:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:8028:x1875453518302336:12345-0@lo:502: 00000100:00100000:2.0:1788571975.805929:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:8028:x1875453518302336:12345-0@lo:502: Request processed in 624us (5824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.805939:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788571975.810243:0:8028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8028:1875453518302336:0@lo:502: 00000100:00100000:2.0:1788571975.810483:0:8028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8028:1875453518302464:0@lo:502: 00000100:00100000:2.0:1788571975.810554:0:8028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.810601:0:8028:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788571975.810671:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518302464 00000100:00100000:0.0:1788571975.810678:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518302464 00000100:00100000:0.0:1788571975.810734:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788571975.810745:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:8028:x1875453518302464:12345-0@lo:502: 00000100:00100000:0.0:1788571975.810986:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:8028:x1875453518302464:12345-0@lo:502: Request processed in 243us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571975.810994:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788571975.811164:0:8028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8028:1875453518302464:0@lo:502: 00000040:00080000:2.0:1788571975.811208:0:8028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788571975.811567:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788571975.811586:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788571975.811596:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.811619:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788571975.811629:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788571975.811631:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788571975.811634:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788571975.811661:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.811669:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.811678:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571975.811694:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302592:0@lo:101: 00000100:00100000:1.0:1788571975.811729:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.811758:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.811773:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518302592 00000100:00100000:1.0:1788571975.811777:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518302592 00000100:00100000:1.0:1788571975.811813:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788571975.811821:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518302592:12345-0@lo:101: 00010000:00010000:1.0:1788571975.811830:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571975.811843:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff4f7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.811865:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff4f7 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.811886:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff4f7 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.811895:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2800, rc 0) 00000100:00100000:1.0:1788571975.811927:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518302592:12345-0@lo:101: Request processed in 108us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571975.811933:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788571975.811965:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302592:0@lo:101: 00010000:00010000:1.0:1788571975.811978:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.811987:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571975.813245:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302720:0@lo:501: 00000100:00100000:1.0:1788571975.813318:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571975.813555:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518302720 00000100:00100000:0.0:1788571975.813562:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518302720 00000100:00100000:0.0:1788571975.813605:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788571975.813613:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518302720:12345-0@lo:501: 00000100:00100000:0.0:1788571975.813839:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518302720:12345-0@lo:501: Request processed in 226us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571975.813847:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788571975.813921:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.813942:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302720:0@lo:501: 00000100:00100000:1.0:1788571975.813973:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302848:0@lo:503: 00000100:00100000:1.0:1788571975.814012:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.814037:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593bae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788571975.814185:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518302848 00000100:00100000:2.0:1788571975.814191:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518302848 00000100:00100000:2.0:1788571975.814225:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788571975.814232:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518302848:12345-0@lo:503: 00000100:00100000:2.0:1788571975.814633:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518302848:12345-0@lo:503: Request processed in 400us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.814649:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788571975.814696:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518302848:0@lo:503: 00000100:00100000:2.0:1788571975.819628:0:8029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8029:1875453518302976:0@lo:502: 00000100:00100000:2.0:1788571975.819714:0:8029:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.819763:0:8029:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788571975.819813:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518302976 00000100:00100000:3.0:1788571975.819820:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518302976 00000100:00100000:3.0:1788571975.819869:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788571975.819879:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:8029:x1875453518302976:12345-0@lo:502: 00000100:00100000:3.0:1788571975.820622:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:8029:x1875453518302976:12345-0@lo:502: Request processed in 740us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571975.820632:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788571975.820736:0:8029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8029:1875453518302976:0@lo:502: 00000020:01000000:2.0:1788571975.820766:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788571975.820775:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788571975.820778:0:8029:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788571975.820786:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788571975.820788:0:8029:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788571975.820810:0:8029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8029:1875453518303104:0@lo:502: 00000100:00100000:2.0:1788571975.820846:0:8029:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.820882:0:8029:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788571975.820932:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518303104 00000100:00100000:0.0:1788571975.820937:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518303104 00000100:00100000:0.0:1788571975.820975:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788571975.820984:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:8029:x1875453518303104:12345-0@lo:502: 00000100:00100000:0.0:1788571975.821208:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:8029:x1875453518303104:12345-0@lo:502: Request processed in 225us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571975.821215:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788571975.821322:0:8029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8029:1875453518303104:0@lo:502: 00000020:01000000:3.0:1788571975.821341:0:8029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788571975.821471:0:8029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788571975.821473:0:8029:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788571975.821477:0:8029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788571975.827013:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788571975.827049:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788571975.827062:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.827074:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571975.827085:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788571975.827087:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c065ad2800 from 30 10000000:01000000:2.0:1788571975.827090:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788571975.827141:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.827160:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.827172:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571975.827196:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518303232:0@lo:101: 00000100:00100000:2.0:1788571975.827797:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.827878:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048540 going to sleep for 11 seconds 00000100:00100000:3.0:1788571975.827915:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518303232 00000100:00100000:3.0:1788571975.827925:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518303232 00000100:00100000:3.0:1788571975.828008:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788571975.828017:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518303232:12345-0@lo:101: 00010000:00010000:3.0:1788571975.828033:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571975.828047:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff505 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571975.828069:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff505 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571975.828080:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff505 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571975.828088:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387200, rc 0) 00000100:00100000:3.0:1788571975.828141:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518303232:12345-0@lo:101: Request processed in 126us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571975.828148:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788571975.828214:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518303232:0@lo:101: 00010000:00010000:2.0:1788571975.828229:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.828239:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571975.828326:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518303360:0@lo:501: 00000100:00100000:2.0:1788571975.828362:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.828739:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048540 going to sleep for 11 seconds 00000100:00100000:0.0:1788571975.828801:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518303360 00000100:00100000:0.0:1788571975.828807:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518303360 00000100:00100000:0.0:1788571975.828832:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788571975.828840:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518303360:12345-0@lo:501: 00000100:00100000:0.0:1788571975.829154:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518303360:12345-0@lo:501: Request processed in 314us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571975.829161:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788571975.829652:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518303360:0@lo:501: 00000100:00100000:1.0:1788571975.829694:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518303488:0@lo:503: 00000100:00100000:1.0:1788571975.829738:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.829813:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593bab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788571975.829845:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518303488 00000100:00100000:0.0:1788571975.829850:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518303488 00000100:00100000:0.0:1788571975.829914:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788571975.829931:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518303488:12345-0@lo:503: 00000100:00100000:0.0:1788571975.830088:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518303488:12345-0@lo:503: Request processed in 159us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571975.830095:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788571975.830161:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518303488:0@lo:503: 00000100:00100000:1.0:1788571975.830579:0:8030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8030:1875453518303616:0@lo:502: 00000100:00100000:1.0:1788571975.830613:0:8030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.830740:0:8030:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593bac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788571975.830810:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518303616 00000100:00100000:3.0:1788571975.830815:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518303616 00000100:00100000:3.0:1788571975.830840:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788571975.830847:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:8030:x1875453518303616:12345-0@lo:502: 00000100:00100000:3.0:1788571975.831032:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:8030:x1875453518303616:12345-0@lo:502: Request processed in 185us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571975.831038:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788571975.831111:0:8030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8030:1875453518303616:0@lo:502: 00000100:00100000:1.0:1788571975.831168:0:8030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8030:1875453518303744:0@lo:502: 00000100:00100000:1.0:1788571975.831201:0:8030:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.831222:0:8030:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593bac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788571975.831864:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518303744 00000100:00100000:0.0:1788571975.831872:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518303744 00000100:00100000:0.0:1788571975.831903:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788571975.831910:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:8030:x1875453518303744:12345-0@lo:502: 00000100:00100000:0.0:1788571975.832102:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:8030:x1875453518303744:12345-0@lo:502: Request processed in 192us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571975.832109:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788571975.832216:0:8030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8030:1875453518303744:0@lo:502: 00000040:00080000:1.0:1788571975.832239:0:8030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788571975.832518:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788571975.832537:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788571975.832547:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.832557:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571975.832577:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788571975.832580:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88c065ad2800 from 5 10000000:01000000:2.0:1788571975.832582:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788571975.832611:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.832620:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.832629:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571975.832645:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518303872:0@lo:101: 00000100:00100000:2.0:1788571975.832679:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.832714:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048300 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.832755:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518303872 00000100:00100000:1.0:1788571975.832760:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518303872 00000100:00100000:1.0:1788571975.832790:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788571975.832796:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518303872:12345-0@lo:101: 00010000:00010000:1.0:1788571975.832805:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571975.832816:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db3200/0x977d9e7969bff51a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff513 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.832836:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db3200/0x977d9e7969bff51a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff513 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.832846:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db3200/0x977d9e7969bff51a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff513 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.832854:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db3200, rc 0) 00000100:00100000:1.0:1788571975.832891:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518303872:12345-0@lo:101: Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571975.832904:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788571975.832936:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518303872:0@lo:101: 00010000:00010000:1.0:1788571975.832948:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.832956:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571975.832998:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518304000:0@lo:256: 00000100:00100000:1.0:1788571975.833029:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.833042:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.833053:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518304000 00000100:00100000:1.0:1788571975.833056:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518304000 00000100:00100000:1.0:1788571975.833073:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788571975.833078:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518304000:12345-0@lo:256: 20000000:01000000:1.0:1788571975.833090:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788571975.833107:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788571975.833111:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788571975.833202:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518304000:12345-0@lo:256: Request processed in 122us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571975.833209:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788571975.833240:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518304000:0@lo:256: 10000000:01000000:1.0:1788571975.833304:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788571975.833310:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.833320:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788571975.833332:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788571975.833333:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788571975.833335:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788571975.833358:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.833364:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.833371:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571975.833383:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518304128:0@lo:101: 00000100:00100000:1.0:1788571975.833406:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.833420:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.833431:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518304128 00000100:00100000:1.0:1788571975.833435:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518304128 00000100:00100000:1.0:1788571975.833451:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788571975.833456:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518304128:12345-0@lo:101: 00010000:00010000:1.0:1788571975.833463:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571975.833470:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff521 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.833484:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff521 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.833491:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff521 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.833508:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2200, rc 0) 00000100:00100000:1.0:1788571975.833535:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518304128:12345-0@lo:101: Request processed in 78us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571975.833540:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788571975.833568:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518304128:0@lo:101: 00010000:00010000:1.0:1788571975.833577:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.833585:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571975.833626:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518304256:0@lo:501: 00000100:00100000:1.0:1788571975.833650:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.833662:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.833673:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518304256 00000100:00100000:1.0:1788571975.833677:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518304256 00000100:00100000:1.0:1788571975.833693:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788571975.833699:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518304256:12345-0@lo:501: 00000100:00100000:1.0:1788571975.833902:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518304256:12345-0@lo:501: Request processed in 202us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571975.833908:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788571975.833935:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518304256:0@lo:501: 00000100:00100000:1.0:1788571975.833959:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518304384:0@lo:503: 00000100:00100000:1.0:1788571975.833993:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.834006:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.834022:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518304384 00000100:00100000:1.0:1788571975.834025:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518304384 00000100:00100000:1.0:1788571975.834040:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788571975.834045:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518304384:12345-0@lo:503: 00000100:00100000:1.0:1788571975.834346:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518304384:12345-0@lo:503: Request processed in 299us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571975.834353:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788571975.834389:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518304384:0@lo:503: 00000100:00100000:1.0:1788571975.834549:0:8031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8031:1875453518304512:0@lo:502: 00000100:00100000:1.0:1788571975.834581:0:8031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.834597:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518304512 00000100:00100000:1.0:1788571975.834601:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518304512 00000100:00100000:1.0:1788571975.834618:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788571975.834623:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8031:x1875453518304512:12345-0@lo:502: 00000100:00100000:1.0:1788571975.834823:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8031:x1875453518304512:12345-0@lo:502: Request processed in 199us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571975.834829:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788571975.834858:0:8031:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593bacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.834868:0:8031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8031:1875453518304512:0@lo:502: 00000020:01000000:1.0:1788571975.834885:0:8031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788571975.834892:0:8031:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788571975.834898:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571975.834901:0:8031:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788571975.834906:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788571975.834910:0:8031:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:1.0:1788571975.834932:0:8031:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788571975.834935:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788571975.834954:0:8031:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88c0485499c0) 00000020:00000080:1.0:1788571975.834972:0:8031:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788571975.834978:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788571975.835039:0:8031:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788571975.835044:0:8031:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788571975.835054:0:8031:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969bff536 00010000:00080000:1.0:1788571975.835085:0:8031:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88bf4531b000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1788571975.835357:0:8031:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788571975.835629:0:8031:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788571975.835642:0:8031:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788571975.837058:0:8031:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788571975.840690:0:8031:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788571975.840760:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788571975.840826:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788571975.841910:0:8033:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788571975.841917:0:8033:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788571975.847567:0:8031:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788571975.847582:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788571975.847620:0:8031:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788571975.847645:0:8031:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969bff53d 00000100:00080000:1.0:1788571975.847656:0:8031:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788571975.847662:0:8031:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88bf4531b000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788571975.847696:0:8031:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c04754dc00 x1875453518304640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788571975.847719:0:8031:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788571975.847779:0:8031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788571975.847784:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571975.847786:0:8031:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788571975.847789:0:8031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788571975.847792:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571975.847794:0:8031:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788571975.847803:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788571975.847806:0:8031:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788571975.847834:0:8031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8031:1875453518304768:0@lo:502: 00000100:00100000:1.0:1788571975.847910:0:8031:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.847947:0:8031:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593ba3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.847970:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518304768 00000100:00100000:1.0:1788571975.847976:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518304768 00000100:00100000:1.0:1788571975.848013:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788571975.848021:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8031:x1875453518304768:12345-0@lo:502: 00000100:00100000:1.0:1788571975.848283:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8031:x1875453518304768:12345-0@lo:502: Request processed in 262us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571975.848290:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788571975.848342:0:8031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8031:1875453518304768:0@lo:502: 00000020:01000000:1.0:1788571975.848366:0:8031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788571975.848370:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571975.848372:0:8031:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788571975.848376:0:8031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1788571975.848578:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518304640:0@lo:8: 00000100:00100000:0.0:1788571975.848618:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.848902:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518304896:0@lo:400: 00000100:00100000:2.0:1788571975.848933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.848956:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788571975.848962:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518305024:0@lo:400: 00000100:00100000:2.0:1788571975.848994:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.849026:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518305152:0@lo:400: 00000100:00100000:2.0:1788571975.849050:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.849069:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788571975.849074:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518305280:0@lo:400: 00000100:00100000:2.0:1788571975.849096:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.849143:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518304896 00000100:00100000:2.0:1788571975.849149:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518304896 00000100:00100000:2.0:1788571975.849186:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518305024 00000100:00100000:2.0:1788571975.849189:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518305024 00000100:00100000:2.0:1788571975.849209:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518305280 00000100:00100000:2.0:1788571975.849213:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518305280 00000100:00100000:2.0:1788571975.849226:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788571975.849232:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518304896:12345-0@lo:400: 00000100:00100000:2.0:1788571975.849298:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518304896:12345-0@lo:400: Request processed in 65us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.849304:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788571975.849318:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788571975.849325:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518305024:12345-0@lo:400: 00000100:00100000:2.0:1788571975.849479:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518305024:12345-0@lo:400: Request processed in 154us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.849486:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788571975.849498:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788571975.849503:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518305280:12345-0@lo:400: 00000100:00100000:2.0:1788571975.849542:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518305280:12345-0@lo:400: Request processed in 39us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.849547:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788571975.849568:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518304640 00000100:00100000:2.0:1788571975.849572:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518304640 00000100:00100000:2.0:1788571975.849590:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518305152 00000100:00100000:2.0:1788571975.849593:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518305152 00000100:00100000:2.0:1788571975.849613:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788571975.849619:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518305152:12345-0@lo:400: 00000100:00100000:2.0:1788571975.849649:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518305152:12345-0@lo:400: Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.849655:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788571975.849675:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788571975.849679:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3296:x1875453518304640:12345-0@lo:8: 00010000:00080000:2.0:1788571975.849704:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:2.0:1788571975.849732:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969bff544 00002000:00100000:2.0:1788571975.849744:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88bf4746e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788571975.849748:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788571975.849752:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788571975.849871:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788571975.850024:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788571975.850047:0:6680:0:(import.c:65:import_set_state_nolock()) ffff88bf4746d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788571975.850091:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1875453518304640:12345-0@lo:8: Request processed in 409us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.850097:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788571975.850129:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788571975.850134:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788571975.850170:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c04754dc00 x1875453518304640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788571985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571975.850181:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788571975.850189:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788571975.850196:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788571975.850201:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788571975.850204:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf4531b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788571975.850216:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788571975.850221:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518304640:0@lo:8: 00010000:00080000:2.0:1788571975.850321:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c075da5c00 x1875453518305024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571975.850333:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518305024:0@lo:400: 00010000:00080000:0.0:1788571975.850470:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c075da6d80 x1875453518305280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571975.850481:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518305280:0@lo:400: 00010000:00080000:0.0:1788571975.850493:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c075da7800 x1875453518305152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788571991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571975.850500:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518305152:0@lo:400: 00010000:00080000:2.0:1788571975.850622:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c075da5180 x1875453518304896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571975.850630:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518304896:0@lo:400: 00000004:00080000:2.0:1788571975.850671:0:8033:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788571975.850771:0:8033:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 196641522020ns, next at 0ns, rc = 0 00000020:01000000:1.0:1788571975.852511:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788571975.852539:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788571975.852550:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.852562:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788571975.852571:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788571975.852574:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88c04750cd40 from 1 10000000:01000000:1.0:1788571975.852577:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788571975.852611:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.852623:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571975.852634:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571975.852656:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518305408:0@lo:101: 00000100:00100000:1.0:1788571975.852713:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571975.852746:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593bab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788571975.855000:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518305408 00000100:00100000:3.0:1788571975.855014:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518305408 00000100:00100000:3.0:1788571975.855065:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788571975.855074:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518305408:12345-0@lo:101: 00010000:00010000:3.0:1788571975.855089:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571975.855126:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff54b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571975.859786:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff54b expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571975.859809:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff54b expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571975.859819:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387a00, rc 0) 00000100:00100000:3.0:1788571975.859959:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518305408:12345-0@lo:101: Request processed in 4885us (7243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571975.859967:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788571975.860953:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518305408:0@lo:101: 00010000:00010000:2.0:1788571975.860979:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571975.860991:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571975.861075:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518305536:0@lo:501: 00000100:00100000:2.0:1788571975.861141:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571975.861188:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048900 going to sleep for 11 seconds 00000100:00100000:3.0:1788571975.861296:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518305536 00000100:00100000:3.0:1788571975.861303:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518305536 00000100:00100000:3.0:1788571975.861344:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788571975.861354:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518305536:12345-0@lo:501: 00000100:00100000:3.0:1788571975.861576:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518305536:12345-0@lo:501: Request processed in 222us (434us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788571975.861584:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788571975.861718:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518305536:0@lo:501: 10000000:01000000:0.0:1788571975.861750:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788571975.861758:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571975.861768:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788571975.914443:0:8034:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788571975.914477:0:8034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8034:1875453518305792:0@lo:7: 00000100:00100000:0.0:1788571975.914553:0:8034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571975.914586:0:8034:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8540 going to sleep for 11 seconds 00000004:00080000:0.0:1788571975.914614:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788571975.914637:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518305664:0@lo:13: 00000100:00100000:0.0:1788571975.914664:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571975.914722:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518305792 00000100:00100000:0.0:1788571975.914730:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518305792 00000100:00100000:0.0:1788571975.914805:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788571975.914815:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8034:x1875453518305792:12345-0@lo:7: 00000100:00100000:1.0:1788571975.922336:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518305664 00000100:00100000:1.0:1788571975.922361:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518305664 00000100:00100000:1.0:1788571975.922417:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788571975.922427:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518305664:12345-0@lo:13: 00002000:00000024:1.0:1788571975.922463:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788571975.922547:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518305664:12345-0@lo:13: Request processed in 121us (7882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571975.922553:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788571975.922811:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076678000 x1875453518305664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788571991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571975.922833:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518305664:0@lo:13: 00000100:00080000:0.0:1788571975.922860:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788571975.927212:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788571975.927223:0:6680:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788571975.927508:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8034:x1875453518305792:12345-0@lo:7: Request processed in 12690us (12950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571975.927520:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788571975.927580:0:8034:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679500 x1875453518305792/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788571991 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571975.927597:0:8034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8034:1875453518305792:0@lo:7: 00000004:00080000:0.0:1788571975.927611:0:8034:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788571975.927650:0:8034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8034:1875453518305920:0@lo:5: 00000100:00100000:0.0:1788571975.927694:0:8034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571975.927732:0:8034:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788571975.927747:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518305920 00000100:00100000:0.0:1788571975.927752:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518305920 00000100:00100000:0.0:1788571975.927797:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788571975.927806:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8034:x1875453518305920:12345-0@lo:5: 00002000:00080000:0.0:1788571975.927833:0:6679:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788571975.927837:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788571975.928057:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8034:x1875453518305920:12345-0@lo:5: Request processed in 251us (362us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788571975.928064:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788571975.928093:0:8034:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679500 x1875453518305920/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788571991 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571975.928106:0:8034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8034:1875453518305920:0@lo:5: 00000004:00080000:0.0:1788571975.928223:0:8034:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788571975.928651:0:8034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8034:1875453518306048:0@lo:700: 00000100:00100000:0.0:1788571975.928684:0:8034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571975.928765:0:8034:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.931518:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518306048 00000100:00100000:1.0:1788571975.931534:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518306048 00000100:00100000:0.0:1788571975.931735:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788571975.931748:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8034:x1875453518306048:12345-0@lo:700: 00000100:00100000:0.0:1788571975.931807:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6687:1875453518306176:0@lo:700: 00000100:00100000:0.0:1788571975.931871:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571975.931910:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788571975.933276:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518306176 00000100:00100000:1.0:1788571975.933288:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518306176 00000100:00100000:1.0:1788571975.933340:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788571975.934469:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6687:x1875453518306176:12345-0@lo:700: 40000000:02000000:2.0:1788571975.982322:0:5837:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788571975.995544:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6687:x1875453518306176:12345-0@lo:700: Request processed in 61078us (63666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571975.995558:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788571975.995614:0:6687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679f80 x1875453518306176/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788571991 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571975.995628:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6687:1875453518306176:0@lo:700: 40000000:02000000:2.0:1788571975.995640:0:6687:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788571976.144793:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788571976.144825:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788571976.145524:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8034:x1875453518306048:12345-0@lo:700: Request processed in 213773us (216832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571976.145553:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788571976.145730:0:8034:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679c00 x1875453518306048/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788571991 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571976.145743:0:8034:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788571976.145759:0:8034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8034:1875453518306048:0@lo:700: 00000004:02000040:3.0:1788571976.198881:0:8034:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788571976.202786:0:8034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8034:1875453518306304:0@lo:5: 00000100:00100000:3.0:1788571976.202856:0:8034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571976.202915:0:8034:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052082900 going to sleep for 11 seconds 00000100:00100000:1.0:1788571976.202971:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518306304 00000100:00100000:1.0:1788571976.202979:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518306304 00000100:00100000:1.0:1788571976.203035:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788571976.203045:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8034:x1875453518306304:12345-0@lo:5: 00002000:00080000:1.0:1788571976.210990:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788571976.211013:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788571976.218669:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8034:x1875453518306304:12345-0@lo:5: Request processed in 15619us (15806us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788571976.218682:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788571976.218790:0:8034:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c557b80 x1875453518306304/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788571992 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571976.218807:0:8034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8034:1875453518306304:0@lo:5: 00000004:00080000:2.0:1788571976.218820:0:8034:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788571976.424565:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571976.815390:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518306432:0@lo:13: 00000100:00100000:1.0:1788571976.815479:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571976.815560:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518306432 00000100:00100000:3.0:1788571976.815570:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518306432 00000100:00100000:3.0:1788571976.815631:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788571976.815649:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518306432:12345-0@lo:13: 00002000:00000024:3.0:1788571976.815684:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788571976.821634:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518306432:12345-0@lo:13: Request processed in 5974us (6142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571976.821650:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788571976.822323:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050631c00 x1875453518306432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788571992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571976.822350:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518306432:0@lo:13: 00010000:00010000:1.0:1788571977.448444:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571978.473040:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571979.496498:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571980.527376:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788571980.626873:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788571980.905588:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518306560:0@lo:400: 00000100:00100000:3.0:1788571980.905662:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571980.905708:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518307072:0@lo:400: 00000100:00100000:3.0:1788571980.905754:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571980.905778:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788571980.905783:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518306688:0@lo:400: 00000100:00100000:3.0:1788571980.905889:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571980.905904:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518307200:0@lo:400: 00000100:00100000:3.0:1788571980.905926:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571980.905959:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518306560 00000100:00100000:3.0:1788571980.905965:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518306560 00000100:00100000:3.0:1788571980.906007:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788571980.906016:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518306560:12345-0@lo:400: 00000100:00100000:3.0:1788571980.906074:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518306560:12345-0@lo:400: Request processed in 58us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571980.906082:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788571980.906136:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518306560:0@lo:400: 00000100:00100000:1.0:1788571980.906445:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518306944:0@lo:400: 00000100:00100000:1.0:1788571980.906479:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571980.906505:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788571980.906511:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518306816:0@lo:400: 00000100:00100000:1.0:1788571980.906529:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571980.906552:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518307200 00000100:00100000:1.0:1788571980.906555:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518307200 00000100:00100000:1.0:1788571980.906593:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518306944 00000100:00100000:1.0:1788571980.906596:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518306944 00000100:00100000:1.0:1788571980.906611:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788571980.906619:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518307200:12345-0@lo:400: 00000100:00100000:1.0:1788571980.906659:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518307200:12345-0@lo:400: Request processed in 42us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571980.906675:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788571980.906691:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788571980.906697:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518306944:12345-0@lo:400: 00000100:00100000:1.0:1788571980.906742:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518306944:12345-0@lo:400: Request processed in 45us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571980.906747:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788571980.906763:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788571980.906766:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788571980.906860:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c555180 x1875453518306944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788571996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571980.906874:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518306944:0@lo:400: 00010000:00080000:1.0:1788571980.906906:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c555c00 x1875453518307200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788571996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571980.906914:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788571980.906922:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518307200:0@lo:400: 00000100:00100000:2.0:1788571980.907401:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518307072 00000100:00100000:2.0:1788571980.907408:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518307072 00000100:00100000:2.0:1788571980.907440:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518306688 00000100:00100000:2.0:1788571980.907443:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518306688 00000100:00100000:2.0:1788571980.907454:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518306816 00000100:00100000:2.0:1788571980.907457:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518306816 00000100:00100000:2.0:1788571980.907470:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788571980.907476:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518307072:12345-0@lo:400: 00000100:00100000:2.0:1788571980.907525:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518307072:12345-0@lo:400: Request processed in 49us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571980.907532:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788571980.907545:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788571980.907550:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518306688:12345-0@lo:400: 00000100:00100000:2.0:1788571980.907574:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518306688:12345-0@lo:400: Request processed in 24us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571980.907579:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788571980.907599:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788571980.907605:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518306816:12345-0@lo:400: 00000100:00100000:2.0:1788571980.907640:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518306816:12345-0@lo:400: Request processed in 35us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571980.907645:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788571980.907665:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788571980.907683:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c554000 x1875453518306688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571980.907693:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518306688:0@lo:400: 00010000:00080000:2.0:1788571980.907703:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c556a00 x1875453518307072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571980.907723:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518307072:0@lo:400: 00010000:00080000:2.0:1788571980.907752:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c555500 x1875453518306816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788571996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571980.907760:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518306816:0@lo:400: 00000100:00100000:2.0:1788571981.341981:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571981.350792:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495214208 00000100:00100000:3.0:1788571981.350808:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495214208 00000100:00100000:3.0:1788571981.350868:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:3.0:1788571981.350886:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1875453495214208:12345-192.168.202.2@tcp:250: 00010000:00080000:3.0:1788571981.350917:0:5824:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d4ae064e-d360-4402-a9f8-841f0545fa17@192.168.202.2@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1788571981.350947:0:5824:0:(genops.c:1385:class_connect()) connect: client d4ae064e-d360-4402-a9f8-841f0545fa17, cookie 0x977d9e7969bff559 00000100:00080000:3.0:1788571981.351372:0:5824:0:(import.c:65:import_set_state_nolock()) ffff88c058aaa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788571981.351443:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+5:2352:x1875453495214208:12345-192.168.202.2@tcp:250: Request processed in 557us (9473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571981.351450:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:1.0:1788571981.371869:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571981.372451:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495214336 00000100:00100000:3.0:1788571981.372466:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495214336 00000100:00100000:3.0:1788571981.372525:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:3.0:1788571981.372536:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+5:5582:x1875453495214336:12345-192.168.202.2@tcp:101: 00010000:00010000:3.0:1788571981.372551:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571981.372567:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10d17 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571981.372598:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d17 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571981.372610:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d17 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571981.372619:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030400, rc 0) 00000100:00100000:3.0:1788571981.375389:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+6:5582:x1875453495214336:12345-192.168.202.2@tcp:101: Request processed in 2843us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571981.375402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:1.0:1788571981.386171:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571981.386363:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495214464 00000100:00100000:3.0:1788571981.386373:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495214464 00000100:00100000:3.0:1788571981.386443:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:3.0:1788571981.386453:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+6:5582:x1875453495214464:12345-192.168.202.2@tcp:501: 00000100:00100000:3.0:1788571981.386721:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+6:5582:x1875453495214464:12345-192.168.202.2@tcp:501: Request processed in 269us (572us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788571981.386729:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:3.0:1788571981.390030:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571981.390687:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495214592 00000100:00100000:1.0:1788571981.390698:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495214592 00000100:00100000:1.0:1788571981.390756:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:1.0:1788571981.390766:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+6:5582:x1875453495214592:12345-192.168.202.2@tcp:101: 00010000:00010000:1.0:1788571981.390783:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571981.390801:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10d1e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571981.390828:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d1e expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571981.390849:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d1e expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571981.390859:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db3000, rc 0) 00000100:00100000:1.0:1788571981.390913:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+7:5582:x1875453495214592:12345-192.168.202.2@tcp:101: Request processed in 148us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571981.390919:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:1.0:1788571981.407773:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571981.407811:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495214720 00000100:00100000:1.0:1788571981.407821:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495214720 00000100:00100000:1.0:1788571981.407866:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:1.0:1788571981.407875:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+7:5582:x1875453495214720:12345-192.168.202.2@tcp:501: 00000100:00100000:1.0:1788571981.408129:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+8:5582:x1875453495214720:12345-192.168.202.2@tcp:501: Request processed in 254us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571981.408137:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:0.0:1788571981.413905:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571981.413986:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495214848 00000100:00100000:3.0:1788571981.413997:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495214848 00000100:00100000:3.0:1788571981.414063:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:3.0:1788571981.414084:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+8:5582:x1875453495214848:12345-192.168.202.2@tcp:503: 00000100:00100000:3.0:1788571981.414663:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+8:5582:x1875453495214848:12345-192.168.202.2@tcp:503: Request processed in 581us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571981.414674:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:1.0:1788571981.418857:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571981.418972:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495214976 00000100:00100000:3.0:1788571981.418982:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495214976 00000100:00100000:3.0:1788571981.419043:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:3.0:1788571981.419053:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+8:5602:x1875453495214976:12345-192.168.202.2@tcp:502: 00000100:00100000:3.0:1788571981.419867:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+8:5602:x1875453495214976:12345-192.168.202.2@tcp:502: Request processed in 811us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571981.419877:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:2.0:1788571981.423048:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788571981.423073:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518307328:0@lo:13: 00000100:00100000:2.0:1788571981.423140:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571981.423228:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518307328 00000100:00100000:2.0:1788571981.423237:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518307328 00000100:00100000:2.0:1788571981.424131:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788571981.424143:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518307328:12345-0@lo:13: 00002000:00000024:2.0:1788571981.424189:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788571981.424283:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518307328:12345-0@lo:13: Request processed in 142us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571981.424299:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788571981.425982:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050633480 x1875453518307328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788571997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571981.426338:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518307328:0@lo:13: 00000100:00100000:3.0:1788571981.466572:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571981.466603:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495215104 00000100:00100000:3.0:1788571981.466612:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495215104 00000100:00100000:3.0:1788571981.466661:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:3.0:1788571981.466670:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+8:5602:x1875453495215104:12345-192.168.202.2@tcp:502: 00000100:00100000:3.0:1788571981.467196:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+8:5602:x1875453495215104:12345-192.168.202.2@tcp:502: Request processed in 524us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571981.467212:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:3.0:1788571981.481679:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571981.481777:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495215232 00000100:00100000:0.0:1788571981.481786:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495215232 00000100:00100000:0.0:1788571981.481839:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:0.0:1788571981.481850:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+8:5582:x1875453495215232:12345-192.168.202.2@tcp:101: 00010000:00010000:0.0:1788571981.481865:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571981.481885:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b91600/0x977d9e7969bff56e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10d48 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571981.481914:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b91600/0x977d9e7969bff56e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d48 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571981.481924:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b91600/0x977d9e7969bff56e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d48 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571981.481934:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91600, rc 0) 00000100:00100000:0.0:1788571981.481996:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5582:x1875453495215232:12345-192.168.202.2@tcp:101: Request processed in 148us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571981.482002:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:3.0:1788571981.487348:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571981.487435:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495215360 00000100:00100000:0.0:1788571981.487445:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495215360 00000100:00100000:0.0:1788571981.487503:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:0.0:1788571981.487514:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5582:x1875453495215360:12345-192.168.202.2@tcp:256: 20000000:01000000:0.0:1788571981.487540:0:5823:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788571981.487565:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788571981.487570:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788571981.487573:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788571981.487581:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788571981.490093:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5582:x1875453495215360:12345-192.168.202.2@tcp:256: Request processed in 2571us (2745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571981.490107:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:2.0:1788571981.493785:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571981.493987:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495215488 00000100:00100000:3.0:1788571981.493997:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495215488 00000100:00100000:3.0:1788571981.494076:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:3.0:1788571981.494087:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5582:x1875453495215488:12345-192.168.202.2@tcp:101: 00010000:00010000:3.0:1788571981.494105:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571981.494124:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10d4f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571981.494154:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d4f expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571981.494167:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d4f expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571981.494177:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030600, rc 0) 00000100:00100000:3.0:1788571981.494241:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5582:x1875453495215488:12345-192.168.202.2@tcp:101: Request processed in 156us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571981.494278:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:3.0:1788571981.502592:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571981.502716:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495215616 00000100:00100000:0.0:1788571981.502726:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495215616 00000100:00100000:0.0:1788571981.502782:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:0.0:1788571981.502803:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5582:x1875453495215616:12345-192.168.202.2@tcp:501: 00000100:00100000:0.0:1788571981.503235:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5582:x1875453495215616:12345-192.168.202.2@tcp:501: Request processed in 433us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571981.503571:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:2.0:1788571981.511974:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571981.512367:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495215744 00000100:00100000:0.0:1788571981.512378:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495215744 00000100:00100000:0.0:1788571981.512441:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:0.0:1788571981.512452:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5582:x1875453495215744:12345-192.168.202.2@tcp:503: 00000100:00100000:0.0:1788571981.513183:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5582:x1875453495215744:12345-192.168.202.2@tcp:503: Request processed in 730us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571981.513193:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:3.0:1788571981.525106:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788571981.525240:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495215872 00000100:00100000:2.0:1788571981.525283:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495215872 00000100:00100000:2.0:1788571981.525341:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:2.0:1788571981.525352:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5605:x1875453495215872:12345-192.168.202.2@tcp:502: 00000100:00100000:2.0:1788571981.525620:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5605:x1875453495215872:12345-192.168.202.2@tcp:502: Request processed in 268us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571981.525628:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:0.0:1788571981.529407:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571981.529500:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495216000 00000100:00100000:3.0:1788571981.529513:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495216000 00000100:00100000:3.0:1788571981.529571:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:3.0:1788571981.529580:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5605:x1875453495216000:12345-192.168.202.2@tcp:502: 00000100:00100000:3.0:1788571981.531066:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5605:x1875453495216000:12345-192.168.202.2@tcp:502: Request processed in 1479us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571981.531079:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 127 00010000:00010000:2.0:1788571981.544899:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571981.551164:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788571981.551503:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495216128 00000100:00100000:2.0:1788571981.551516:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495216128 00000100:00100000:2.0:1788571981.551619:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:2.0:1788571981.551628:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875453495216128:12345-192.168.202.2@tcp:38: 00010000:00080000:2.0:1788571981.551667:0:5830:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:2.0:1788571981.551711:0:5830:0:(genops.c:1385:class_connect()) connect: client 78708c10-ef63-4de2-8b1c-aff484c98227, cookie 0x977d9e7969bff57c 00000004:00100000:2.0:1788571981.551739:0:5830:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788571981.551745:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788571981.646048:0:5830:0:(import.c:65:import_set_state_nolock()) ffff88bf4746f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788571981.646135:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2352:x1875453495216128:12345-192.168.202.2@tcp:38: Request processed in 94504us (94979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571981.646147:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788571981.928647:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518307456:0@lo:13: 00000100:00100000:0.0:1788571981.928720:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571981.928882:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518307456 00000100:00100000:1.0:1788571981.928891:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518307456 00000100:00100000:1.0:1788571981.928935:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788571981.928943:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518307456:12345-0@lo:13: 00002000:00000024:1.0:1788571981.928974:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788571981.929052:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518307456:12345-0@lo:13: Request processed in 109us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571981.929059:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788571981.929134:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050632680 x1875453518307456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788571997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571981.929152:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518307456:0@lo:13: 00010000:00010000:1.0:1788571982.568953:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788571982.668890:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788571982.668975:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495216384 00000100:00100000:2.0:1788571982.668984:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495216384 00000100:00100000:2.0:1788571982.669067:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1788571982.669078:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:5582:x1875453495216384:12345-192.168.202.2@tcp:41: 00000004:00000024:2.0:1788571982.669118:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788571982.669185:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:5582:x1875453495216384:12345-192.168.202.2@tcp:41: Request processed in 110us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571982.669193:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788571982.670902:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788571982.670991:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495216256 00000100:00100000:2.0:1788571982.671009:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495216256 00000100:00100000:2.0:1788571982.671080:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:2.0:1788571982.671090:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:0:x1875453495216256:12345-192.168.202.2@tcp:41: 00000004:00000024:2.0:1788571982.671121:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788571982.671195:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:0:x1875453495216256:12345-192.168.202.2@tcp:41: Request processed in 106us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571982.671203:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00080000:1.0:1788571982.673435:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788571982.677846:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571982.686621:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495216512 00000100:00100000:0.0:1788571982.686640:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495216512 00000100:00100000:0.0:1788571982.686795:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788571982.686807:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:5582:x1875453495216512:12345-192.168.202.2@tcp:40: 00000100:00100000:0.0:1788571982.686923:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:5582:x1875453495216512:12345-192.168.202.2@tcp:40: Request processed in 118us (9087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571982.686931:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788571982.701352:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571982.701403:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571982.701553:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495216640 00000100:00100000:3.0:1788571982.701564:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495216640 00000100:00100000:3.0:1788571982.701597:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495216768 00000100:00100000:3.0:1788571982.701601:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495216768 00000100:00100000:3.0:1788571982.701613:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788571982.701622:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875453495216640:12345-192.168.202.2@tcp:8: 00010000:00080000:3.0:1788571982.701652:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1788571982.701685:0:6679:0:(genops.c:1385:class_connect()) connect: client 78708c10-ef63-4de2-8b1c-aff484c98227, cookie 0x977d9e7969bff583 00002000:00100000:3.0:1788571982.701697:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 78708c10-ef63-4de2-8b1c-aff484c98227/ffff88c058aad000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788571982.701708:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788571982.702058:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788571982.702090:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88c058aaf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788571982.702166:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2352:x1875453495216640:12345-192.168.202.2@tcp:8: Request processed in 543us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571982.702173:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788571982.702193:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788571982.702198:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875453495216768:12345-192.168.202.2@tcp:8: 00010000:00080000:3.0:1788571982.702215:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1788571982.702232:0:6679:0:(genops.c:1385:class_connect()) connect: client 78708c10-ef63-4de2-8b1c-aff484c98227, cookie 0x977d9e7969bff58a 00002000:00100000:3.0:1788571982.702237:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 78708c10-ef63-4de2-8b1c-aff484c98227/ffff88c058aa8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788571982.702355:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788571982.702563:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788571982.702580:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88c058aa9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788571982.702605:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2352:x1875453495216768:12345-192.168.202.2@tcp:8: Request processed in 405us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571982.702612:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788571982.710053:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571982.710191:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495216896 00000100:00100000:3.0:1788571982.710201:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495216896 00000100:00100000:3.0:1788571982.710299:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1788571982.710317:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:5582:x1875453495216896:12345-192.168.202.2@tcp:33: 00000100:00100000:0.0:1788571982.714548:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788571982.714641:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495217024 00000100:00100000:2.0:1788571982.714651:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495217024 00000100:00100000:2.0:1788571982.714711:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:2.0:1788571982.714722:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495217024:12345-192.168.202.2@tcp:400: 00000100:00100000:2.0:1788571982.714801:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495217024:12345-192.168.202.2@tcp:400: Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571982.714810:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00000004:00080000:3.0:1788571982.759338:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 48957us 00000004:00200000:0.0:1788571982.788764:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788571982.788938:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:5582:x1875453495216896:12345-192.168.202.2@tcp:33: Request processed in 78617us (78899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571982.788953:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1788571983.026728:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571983.026876:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495217152 00000100:00100000:3.0:1788571983.026887:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495217152 00000100:00100000:3.0:1788571983.026951:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788571983.026963:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:5622:x1875453495217152:12345-192.168.202.2@tcp:101: 00010000:00010000:3.0:1788571983.026983:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571983.027019:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031000/0x977d9e7969bff591 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10d79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571983.027087:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969bff598 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571983.027101:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969bff598 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571983.027118:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969bff598 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788571983.027171:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788571983.027175:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788571983.027193:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969bff598 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571983.027228:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031000/0x977d9e7969bff591 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d79 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571983.027405:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969bff598 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d79 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571983.027414:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd100) 00010000:00010000:3.0:1788571983.027417:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788571983.027420:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030000, rc 0) 00000100:00100000:3.0:1788571983.027479:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:5622:x1875453495217152:12345-192.168.202.2@tcp:101: Request processed in 518us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571983.027486:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00010000:00010000:1.0:1788571983.592486:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571984.616438:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571985.094319:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788571985.094469:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495217280 00000100:00100000:2.0:1788571985.094480:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495217280 00000100:00100000:2.0:1788571985.094560:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1788571985.094582:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:5674:x1875453495217280:12345-192.168.202.2@tcp:41: 00000004:00000024:2.0:1788571985.094635:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788571985.094692:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:5674:x1875453495217280:12345-192.168.202.2@tcp:41: Request processed in 112us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571985.094699:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:1.0:1788571985.094834:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788571985.098544:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571985.098770:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495217408 00000100:00100000:1.0:1788571985.098781:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495217408 00000100:00100000:1.0:1788571985.098870:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788571985.098882:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:78708c10-ef63-4de2-8b1c-aff484c98227+6:5674:x1875453495217408:12345-192.168.202.2@tcp:13: 00002000:00000024:1.0:1788571985.098920:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788571985.098994:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:78708c10-ef63-4de2-8b1c-aff484c98227+6:5674:x1875453495217408:12345-192.168.202.2@tcp:13: Request processed in 115us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571985.099002:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00080000:2.0:1788571985.099121:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788571985.103801:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571985.103906:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495217536 00000100:00100000:1.0:1788571985.103917:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495217536 00000100:00080000:2.0:1788571985.104082:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788571985.104223:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788571985.104235:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:78708c10-ef63-4de2-8b1c-aff484c98227+6:5674:x1875453495217536:12345-192.168.202.2@tcp:13: 00002000:00000024:1.0:1788571985.104315:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788571985.104383:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:78708c10-ef63-4de2-8b1c-aff484c98227+6:5674:x1875453495217536:12345-192.168.202.2@tcp:13: Request processed in 150us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571985.104391:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00010000:00010000:1.0:1788571985.640538:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788571986.030397:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518307968:0@lo:400: 00000100:00100000:2.0:1788571986.030485:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571986.030539:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788571986.030546:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518307840:0@lo:400: 00000100:00100000:2.0:1788571986.030570:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571986.030735:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518307712:0@lo:400: 00000100:00100000:3.0:1788571986.030764:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571986.030793:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518308224:0@lo:400: 00000100:00100000:3.0:1788571986.030814:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571986.030838:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788571986.030843:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518307584:0@lo:400: 00000100:00100000:3.0:1788571986.030873:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571986.030893:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518308096:0@lo:400: 00000100:00100000:3.0:1788571986.030929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571986.030977:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518307968 00000100:00100000:3.0:1788571986.030984:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518307968 00000100:00100000:3.0:1788571986.031040:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518308224 00000100:00100000:3.0:1788571986.031044:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518308224 00000100:00100000:3.0:1788571986.031062:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788571986.031071:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518307968:12345-0@lo:400: 00000100:00100000:3.0:1788571986.031123:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518307968:12345-0@lo:400: Request processed in 52us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571986.031130:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788571986.031146:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788571986.031152:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518308224:12345-0@lo:400: 00000100:00100000:3.0:1788571986.031179:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518308224:12345-0@lo:400: Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571986.031185:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788571986.031199:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518307840 00000100:00100000:3.0:1788571986.031202:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518307840 00000100:00100000:3.0:1788571986.031219:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518307712 00000100:00100000:3.0:1788571986.031222:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518307712 00000100:00100000:3.0:1788571986.031231:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518308096 00000100:00100000:3.0:1788571986.031233:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518308096 00000100:00100000:3.0:1788571986.031270:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788571986.031278:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518307840:12345-0@lo:400: 00000100:00100000:3.0:1788571986.031308:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518307840:12345-0@lo:400: Request processed in 31us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571986.031314:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788571986.031326:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788571986.031332:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518307712:12345-0@lo:400: 00000100:00100000:3.0:1788571986.031364:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518307712:12345-0@lo:400: Request processed in 33us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571986.031370:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788571986.031381:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788571986.031387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518308096:12345-0@lo:400: 00000100:00100000:3.0:1788571986.031411:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518308096:12345-0@lo:400: Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571986.031417:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788571986.031435:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518307584 00000100:00100000:3.0:1788571986.031438:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518307584 00000100:00100000:3.0:1788571986.031462:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788571986.031468:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518307584:12345-0@lo:400: 00000100:00100000:3.0:1788571986.031493:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518307584:12345-0@lo:400: Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571986.031498:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1788571986.031524:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788571986.031528:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788571986.031530:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788571986.031564:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050630380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518307840:0@lo:400: 00010000:00080000:3.0:1788571986.031578:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050630a80 x1875453518307968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788571986.031588:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518307968:0@lo:400: 00000100:00100000:3.0:1788571986.031618:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518307584:0@lo:400: 00000100:00100000:3.0:1788571986.031629:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518308096:0@lo:400: 00000100:00100000:3.0:1788571986.031638:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518307712:0@lo:400: 00010000:00080000:3.0:1788571986.031656:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050632d80 x1875453518308224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788571986.031666:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518308224:0@lo:400: 00000100:00100000:1.0:1788571986.554421:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518308352:0@lo:13: 00000100:00100000:1.0:1788571986.554491:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571986.554569:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518308352 00000100:00100000:1.0:1788571986.554577:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518308352 00000100:00100000:1.0:1788571986.554634:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788571986.554643:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518308352:12345-0@lo:13: 00002000:00000024:1.0:1788571986.554690:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788571986.554735:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518308352:12345-0@lo:13: Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571986.554742:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788571986.554786:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076235f80 x1875453518308352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788571986.554803:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518308352:0@lo:13: 00010000:00010000:1.0:1788571986.666331:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571987.049710:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788571987.049748:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518308480:0@lo:13: 00000100:00100000:1.0:1788571987.049837:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571987.051060:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518308480 00000100:00100000:0.0:1788571987.051070:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518308480 00000100:00100000:0.0:1788571987.051136:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788571987.051147:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518308480:12345-0@lo:13: 00002000:00000024:0.0:1788571987.051182:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788571987.051272:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518308480:12345-0@lo:13: Request processed in 106us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571987.051292:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788571987.051352:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050630700 x1875453518308480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571987.051374:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518308480:0@lo:13: 00000001:00100000:2.0:1788571987.126619:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000001:00100000:1.0:1788571987.143981:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00010000:00010000:3.0:1788571987.688835:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788571987.689649:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000100:00100000:1.0:1788571987.822500:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571987.822549:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571987.822573:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571987.822594:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571987.823301:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495217664 00000100:00100000:3.0:1788571987.823312:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495217664 00000100:00100000:3.0:1788571987.823364:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:3.0:1788571987.823375:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2355:x1875453495217664:12345-192.168.202.2@tcp:400: 00000100:00100000:3.0:1788571987.823444:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2355:x1875453495217664:12345-192.168.202.2@tcp:400: Request processed in 70us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571987.823451:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:3.0:1788571987.823486:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495217920 00000100:00100000:3.0:1788571987.823489:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495217920 00000100:00100000:3.0:1788571987.823518:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495218048 00000100:00100000:3.0:1788571987.823521:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495218048 00000100:00100000:3.0:1788571987.823625:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788571987.823633:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495217920:12345-192.168.202.2@tcp:400: 00000100:00100000:3.0:1788571987.823661:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495217920:12345-192.168.202.2@tcp:400: Request processed in 30us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571987.823667:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788571987.823679:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1788571987.823685:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495218048:12345-192.168.202.2@tcp:400: 00000100:00100000:3.0:1788571987.823703:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495218048:12345-192.168.202.2@tcp:400: Request processed in 19us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571987.823709:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1788571987.823732:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495217792 00000100:00100000:3.0:1788571987.823736:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495217792 00000100:00100000:3.0:1788571987.823761:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788571987.823767:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495217792:12345-192.168.202.2@tcp:400: 00000100:00100000:3.0:1788571987.823794:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495217792:12345-192.168.202.2@tcp:400: Request processed in 27us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571987.823800:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00080000:3.0:1788571987.825367:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788571987.825375:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788571987.825377:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788571987.981028:0:8291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788571988.712591:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571989.737408:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571990.772915:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788571991.145239:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518308608:0@lo:400: 00000100:00100000:2.0:1788571991.145327:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.145374:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518309120:0@lo:400: 00000100:00100000:2.0:1788571991.145400:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.145427:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788571991.145433:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518308736:0@lo:400: 00000100:00100000:2.0:1788571991.145453:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.145470:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518309248:0@lo:400: 00000100:00100000:2.0:1788571991.145493:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.145520:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518308864:0@lo:400: 00000100:00100000:2.0:1788571991.145544:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.145562:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788571991.145581:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518308992:0@lo:400: 00000100:00100000:2.0:1788571991.145617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.145650:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518308608 00000100:00100000:2.0:1788571991.145657:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518308608 00000100:00100000:2.0:1788571991.145700:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788571991.145709:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518308608:12345-0@lo:400: 00000100:00100000:2.0:1788571991.145755:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518308608:12345-0@lo:400: Request processed in 47us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571991.145763:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788571991.145806:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518309120 00000100:00100000:2.0:1788571991.145810:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518309120 00000100:00100000:2.0:1788571991.145835:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518308736 00000100:00100000:2.0:1788571991.145838:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518308736 00000100:00100000:2.0:1788571991.145858:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518308864 00000100:00100000:2.0:1788571991.145861:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518308864 00000100:00100000:2.0:1788571991.145877:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788571991.145883:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518309120:12345-0@lo:400: 00000100:00100000:2.0:1788571991.145913:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518309120:12345-0@lo:400: Request processed in 31us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571991.145919:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788571991.145930:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788571991.145935:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518308736:12345-0@lo:400: 00000100:00100000:2.0:1788571991.145958:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518308736:12345-0@lo:400: Request processed in 24us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571991.145964:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788571991.145974:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788571991.145980:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518308864:12345-0@lo:400: 00000100:00100000:2.0:1788571991.146007:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518308864:12345-0@lo:400: Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571991.146019:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788571991.146040:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518309248 00000100:00100000:2.0:1788571991.146044:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518309248 00000100:00100000:2.0:1788571991.146066:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518308992 00000100:00100000:2.0:1788571991.146068:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518308992 00000100:00100000:2.0:1788571991.146081:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788571991.146087:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518309248:12345-0@lo:400: 00000100:00100000:2.0:1788571991.146117:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518309248:12345-0@lo:400: Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571991.146122:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788571991.146132:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788571991.146137:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518308992:12345-0@lo:400: 00000100:00100000:2.0:1788571991.146163:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518308992:12345-0@lo:400: Request processed in 25us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571991.146168:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788571991.146209:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050630e00 x1875453518308992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571991.146222:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518308992:0@lo:400: 00000100:00100000:2.0:1788571991.146233:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518308864:0@lo:400: 00000100:00100000:2.0:1788571991.146291:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518308736:0@lo:400: 00010000:00080000:2.0:1788571991.146302:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050631880 x1875453518309248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571991.146309:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518309248:0@lo:400: 00000100:00100000:2.0:1788571991.146317:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518308608:0@lo:400: 00000100:00100000:2.0:1788571991.146336:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518309120:0@lo:400: 00000100:00080000:3.0:1788571991.147208:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788571991.147214:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788571991.147219:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788571991.658006:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788571991.658032:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518309376:0@lo:13: 00000100:00100000:2.0:1788571991.658097:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571991.658328:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518309376 00000100:00100000:1.0:1788571991.658336:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518309376 00000100:00100000:1.0:1788571991.658387:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788571991.658396:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518309376:12345-0@lo:13: 00002000:00000024:1.0:1788571991.658430:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788571991.658472:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518309376:12345-0@lo:13: Request processed in 77us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571991.658484:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788571991.659043:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050632300 x1875453518309376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571991.659062:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518309376:0@lo:13: 00000020:00000080:0.0:1788571991.717199:0:8439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce3d18060 20000000:00000080:0.0:1788571991.717217:0:8439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88c07ba7a000 uarg=0000000000000000 20000000:01000000:0.0:1788571991.717568:0:8439:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788571991.717571:0:8439:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788571991.717581:0:8439:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788571991.717586:0:8439:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788571991.717591:0:8439:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788571991.717604:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788571991.717607:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788571991.717779:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788571991.717782:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788571991.718592:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788571991.719033:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788571991.719104:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788571991.719466:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1788571991.719482:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788571991.719484:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788571991.720063:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788571991.720600:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788571991.720641:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788571991.720674:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788571991.720686:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788571991.720688:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788571991.721642:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788571991.722043:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788571991.722104:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788571991.722215:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788571991.722227:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788571991.722230:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788571991.731080:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788571991.731637:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788571991.731689:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788571991.731742:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1788571991.731759:0:8439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788571991.731777:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731796:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff495 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731804:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff4bf expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731819:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff4e9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731826:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff4f7 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731833:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff505 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731855:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff521 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731863:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff54b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731873:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d17 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731880:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d1e expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731888:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731929:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d1e expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.731947:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d1e expref: 9 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.731973:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518309504:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788571991.732075:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d17 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.732084:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d17 expref: 9 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.732093:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518309632:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788571991.732123:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff54b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.732131:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff54b expref: 18 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.732139:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518309760:0@lo:104: 00000100:00100000:0.0:1788571991.732176:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788571991.732215:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff521 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.732223:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff521 expref: 18 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.732231:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518309888:0@lo:104: 00000100:00100000:0.0:1788571991.732281:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788571991.732307:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff505 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.732316:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff505 expref: 18 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.732330:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310016:0@lo:104: 00010000:00010000:0.0:1788571991.732353:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff4f7 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.732361:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff4f7 expref: 18 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.732369:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310144:0@lo:104: 00010000:00010000:0.0:1788571991.732402:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff4e9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.732410:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff4e9 expref: 18 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.732419:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310272:0@lo:104: 00010000:00010000:0.0:1788571991.732441:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff4bf expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.732449:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff4bf expref: 18 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.732457:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310400:0@lo:104: 00010000:00010000:0.0:1788571991.732477:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff495 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.732486:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff495 expref: 18 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.732504:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310528:0@lo:104: 00000100:00100000:0.0:1788571991.732521:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cb900 going to sleep for 11 seconds 00000100:00100000:2.0:1788571991.732668:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788571991.732686:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.732699:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.732707:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.732715:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.732723:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571991.732731:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518309760 00000100:00100000:2.0:1788571991.732738:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518309760 00000100:00100000:2.0:1788571991.732771:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518309888 00000100:00100000:2.0:1788571991.732774:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518309888 00000100:00100000:2.0:1788571991.732782:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518310016 00000100:00100000:2.0:1788571991.732784:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518310016 00000100:00100000:2.0:1788571991.732792:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518310144 00000100:00100000:2.0:1788571991.732794:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518310144 00000100:00100000:2.0:1788571991.732802:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518310272 00000100:00100000:2.0:1788571991.732804:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518310272 00000100:00100000:2.0:1788571991.732812:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518310400 00000100:00100000:2.0:1788571991.732813:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518310400 00000100:00100000:2.0:1788571991.732821:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518310528 00000100:00100000:2.0:1788571991.732830:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518310528 00000100:00100000:2.0:1788571991.732859:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788571991.732867:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:8439:x1875453518309760:12345-0@lo:104: 00010000:00010000:2.0:1788571991.732881:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.733017:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518309760:0@lo:104: 00010000:00010000:2.0:1788571991.733048:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788571991.733055:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+9:8439:x1875453518309760:12345-0@lo:104: Request processed in 189us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571991.733063:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788571991.733080:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788571991.733087:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076669450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+8:8439:x1875453518309888:12345-0@lo:104: 00010000:00010000:2.0:1788571991.733094:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.733170:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518309888:0@lo:104: 00010000:00010000:3.0:1788571991.741179:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788571991.741192:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741203:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3800 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788571991.741207:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741218:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788571991.741224:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571991.741229:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788571991.741309:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741317:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788571991.741340:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741347:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c046db3800/0x977d9e7969bff54b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff552 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741360:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788571991.741364:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741369:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788571991.741372:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741378:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788571991.741384:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571991.741389:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788571991.741403:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741409:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788571991.741430:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741446:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff521 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff528 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741456:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571991.741458:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571991.741460:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571991.741479:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518310656:0@lo:103: 00000100:00100000:3.0:1788571991.741546:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571991.741604:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788571991.741613:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518310784:0@lo:103: 00000100:00100000:3.0:1788571991.741635:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571991.741664:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518310656 00000100:00100000:3.0:1788571991.741670:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518310656 00010000:00010000:3.0:1788571991.741698:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff54b expref: 19 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571991.741723:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518310784 00000100:00100000:3.0:1788571991.741726:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518310784 00010000:00010000:3.0:1788571991.741738:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff521 expref: 20 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571991.741751:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788571991.741758:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+20:3300:x1875453518310656:12345-0@lo:103: 00010000:00010000:3.0:1788571991.741769:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788571991.741775:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff54b expref: 20 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741784:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff54b expref: 20 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741807:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387a00/0x977d9e7969bff552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff54b expref: 20 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741822:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788571991.741869:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518310656:12345-0@lo:103: Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.741876:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788571991.741892:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788571991.741898:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3298:x1875453518310784:12345-0@lo:103: 00010000:00010000:3.0:1788571991.741906:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788571991.741910:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff521 expref: 18 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741918:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff521 expref: 18 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741928:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff528 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff521 expref: 18 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.741937:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788571991.741963:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3298:x1875453518310784:12345-0@lo:103: Request processed in 65us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.741969:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788571991.742009:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518310784:0@lo:103: 00000100:00100000:3.0:1788571991.742185:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518310656:0@lo:103: 00000100:00100000:3.0:1788571991.742224:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518309504:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788571991.742244:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518309632:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788571991.742525:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788571991.742535:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076669450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+8:8439:x1875453518309888:12345-0@lo:104: Request processed in 9447us (10251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571991.742543:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788571991.742678:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571991.744387:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788571991.744404:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+7:8439:x1875453518310016:12345-0@lo:104: 00010000:00010000:3.0:1788571991.744421:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744569:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788571991.744576:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+7:8439:x1875453518310016:12345-0@lo:104: Request processed in 179us (11889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.744583:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788571991.744604:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788571991.744611:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+6:8439:x1875453518310144:12345-0@lo:104: 00010000:00010000:3.0:1788571991.744619:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744655:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788571991.744660:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+6:8439:x1875453518310144:12345-0@lo:104: Request processed in 51us (11961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.744666:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788571991.744681:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788571991.744686:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744693:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041523800 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788571991.744698:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744706:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788571991.744727:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571991.744733:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788571991.744764:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744770:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788571991.744787:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744794:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff505 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff50c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744808:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788571991.744811:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744817:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3600 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788571991.744820:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744826:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788571991.744833:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571991.744848:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788571991.744870:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744876:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788571991.744889:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744895:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff4f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4fe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.744904:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571991.744906:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571991.744908:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571991.744922:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518311040:0@lo:103: 00000100:00100000:3.0:1788571991.744957:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571991.745000:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518310912:0@lo:103: 00000100:00100000:3.0:1788571991.745022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571991.745050:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518311040 00000100:00100000:3.0:1788571991.745056:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518311040 00010000:00010000:3.0:1788571991.745078:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff4f7 expref: 17 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571991.745098:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518310912 00000100:00100000:3.0:1788571991.745101:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518310912 00010000:00010000:3.0:1788571991.745114:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff505 expref: 18 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571991.745126:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788571991.745132:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3299:x1875453518311040:12345-0@lo:103: 00010000:00010000:3.0:1788571991.745142:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788571991.745155:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff4f7 expref: 18 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745165:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff4f7 expref: 18 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745182:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788571991.745211:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3299:x1875453518311040:12345-0@lo:103: Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.745217:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788571991.745231:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788571991.745238:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3298:x1875453518310912:12345-0@lo:103: 00010000:00010000:3.0:1788571991.745245:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788571991.745274:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff505 expref: 17 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745282:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff505 expref: 17 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745291:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788571991.745318:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3298:x1875453518310912:12345-0@lo:103: Request processed in 80us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.745324:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788571991.745356:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518311040:0@lo:103: 00000100:00100000:3.0:1788571991.745382:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518310912:0@lo:103: 00000100:00100000:3.0:1788571991.745402:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788571991.745409:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:8439:x1875453518310272:12345-0@lo:104: 00010000:00010000:3.0:1788571991.745418:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745457:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788571991.745463:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:8439:x1875453518310272:12345-0@lo:104: Request processed in 55us (12755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.745469:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788571991.745482:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788571991.745489:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:8439:x1875453518310400:12345-0@lo:104: 00010000:00010000:3.0:1788571991.745497:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745528:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788571991.745533:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:8439:x1875453518310400:12345-0@lo:104: Request processed in 45us (12817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.745539:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1788571991.745551:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788571991.745555:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745562:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788571991.745566:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745574:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788571991.745581:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571991.745587:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788571991.745608:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745614:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788571991.745625:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745631:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff4e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4f0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745640:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788571991.745643:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745650:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90e00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788571991.745653:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745659:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788571991.745666:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571991.745672:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788571991.745684:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745690:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788571991.745699:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745717:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b90e00/0x977d9e7969bff4bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4c6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745726:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571991.745728:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571991.745730:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571991.745740:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518311168:0@lo:103: 00000100:00100000:3.0:1788571991.745766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571991.745792:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788571991.745798:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518311296:0@lo:103: 00000100:00100000:3.0:1788571991.745831:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571991.745869:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518311168 00000100:00100000:3.0:1788571991.745873:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518311168 00010000:00010000:3.0:1788571991.745888:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff4e9 expref: 17 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571991.745906:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518311296 00000100:00100000:3.0:1788571991.745909:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518311296 00010000:00010000:3.0:1788571991.745921:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff4bf expref: 18 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571991.745933:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788571991.745939:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3300:x1875453518311168:12345-0@lo:103: 00010000:00010000:3.0:1788571991.745948:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788571991.745952:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff4e9 expref: 18 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745961:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff4e9 expref: 18 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.745978:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788571991.746006:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3300:x1875453518311168:12345-0@lo:103: Request processed in 67us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.746013:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788571991.746025:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788571991.746031:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3298:x1875453518311296:12345-0@lo:103: 00010000:00010000:3.0:1788571991.746038:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788571991.746043:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff4bf expref: 17 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746051:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff4bf expref: 17 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746060:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788571991.746084:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3298:x1875453518311296:12345-0@lo:103: Request processed in 54us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.746091:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788571991.746115:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518311168:0@lo:103: 00000100:00100000:3.0:1788571991.746134:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518311296:0@lo:103: 00000100:00100000:3.0:1788571991.746154:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788571991.746161:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:8439:x1875453518310528:12345-0@lo:104: 00010000:00010000:3.0:1788571991.746170:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746202:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788571991.746207:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:8439:x1875453518310528:12345-0@lo:104: Request processed in 48us (13483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.746219:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788571991.746233:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788571991.746237:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746243:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387800 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788571991.746267:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746276:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788571991.746282:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571991.746288:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788571991.746302:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746308:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788571991.746318:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746325:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387800/0x977d9e7969bff495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff49c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746337:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571991.746339:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788571991.746341:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571991.746349:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518311424:0@lo:103: 00000100:00100000:3.0:1788571991.746382:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571991.746406:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518311424 00000100:00100000:3.0:1788571991.746410:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518311424 00010000:00010000:3.0:1788571991.746423:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff495 expref: 17 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571991.746441:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788571991.746447:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058e7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3298:x1875453518311424:12345-0@lo:103: 00010000:00010000:3.0:1788571991.746454:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788571991.746457:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff495 expref: 17 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746466:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff495 expref: 17 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571991.746475:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788571991.746497:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058e7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3298:x1875453518311424:12345-0@lo:103: Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571991.746503:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788571991.746543:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518311424:0@lo:103: 00010000:00010000:1.0:1788571991.746627:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571991.746634:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788571991.749329:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387200/0x977d9e7969bff50c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff505 expref: 16 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.749354:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310016:0@lo:104: 00010000:00010000:0.0:1788571991.749371:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2800/0x977d9e7969bff4fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff4f7 expref: 15 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.749380:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310144:0@lo:104: 00010000:00010000:0.0:1788571991.749390:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041522800/0x977d9e7969bff4f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff4e9 expref: 14 pid: 5825 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.749399:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310272:0@lo:104: 00010000:00010000:0.0:1788571991.749408:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387000/0x977d9e7969bff4c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff4bf expref: 13 pid: 5823 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.749416:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310400:0@lo:104: 00010000:00010000:0.0:1788571991.749425:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041386c00/0x977d9e7969bff49c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff495 expref: 12 pid: 5824 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.749434:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875453518310528:0@lo:104: 00010000:00010000:0.0:1788571991.749478:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571991.753336:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571991.753368:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571991.753435:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495218176 00000100:00100000:1.0:1788571991.753445:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495218176 00010000:00010000:1.0:1788571991.753481:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d1e expref: 10 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571991.753517:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495218304 00000100:00100000:1.0:1788571991.753520:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495218304 00010000:00010000:1.0:1788571991.753534:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d17 expref: 11 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571991.753549:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1788571991.753558:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+11:2355:x1875453495218176:12345-192.168.202.2@tcp:103: 00010000:00010000:1.0:1788571991.753570:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788571991.753576:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d1e expref: 11 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753588:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d1e expref: 11 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753605:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3000/0x977d9e7969bff567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d1e expref: 11 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753620:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788571991.753668:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2355:x1875453495218176:12345-192.168.202.2@tcp:103: Request processed in 111us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571991.753691:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1788571991.753708:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:1.0:1788571991.753715:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+9:2355:x1875453495218304:12345-192.168.202.2@tcp:103: 00010000:00010000:1.0:1788571991.753723:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788571991.753728:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d17 expref: 9 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753737:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d17 expref: 9 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753747:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030400/0x977d9e7969bff560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d17 expref: 9 pid: 5825 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753758:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753766:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753780:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753788:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753795:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753802:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753814:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788571991.753818:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753826:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753849:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571991.753860:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788571991.753881:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+8:2355:x1875453495218304:12345-192.168.202.2@tcp:103: Request processed in 166us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571991.753889:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:0.0:1788571991.754040:0:8439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.754047:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571991.754053:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff59f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571991.793439:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571992.169215:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518311552:0@lo:13: 00000100:00100000:3.0:1788571992.169343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571992.179221:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518311552 00000100:00100000:0.0:1788571992.179237:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518311552 00000100:00100000:0.0:1788571992.179323:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788571992.179333:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518311552:12345-0@lo:13: 00002000:00000024:0.0:1788571992.179371:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788571992.179453:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518311552:12345-0@lo:13: Request processed in 121us (10111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571992.179460:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788571992.180958:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050632a00 x1875453518311552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571992.180985:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518311552:0@lo:13: 00010000:00010000:1.0:1788571992.808830:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571992.925588:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571992.925694:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788571992.925786:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495218560 00000100:00100000:2.0:1788571992.925796:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495218560 00000100:00100000:2.0:1788571992.925907:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1788571992.925918:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495218560:12345-192.168.202.2@tcp:400: 00000100:00100000:2.0:1788571992.925990:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495218560:12345-192.168.202.2@tcp:400: Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571992.925997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00080000:3.0:1788571992.926207:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788571992.926812:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495218432 00000100:00100000:1.0:1788571992.926924:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495218432 00000100:00100000:1.0:1788571992.927012:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:1.0:1788571992.927021:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+8:2353:x1875453495218432:12345-192.168.202.2@tcp:400: 00000100:00100000:1.0:1788571992.927116:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+8:2353:x1875453495218432:12345-192.168.202.2@tcp:400: Request processed in 96us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571992.927123:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:3.0:1788571992.934938:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571992.935034:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788571992.935207:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495218816 00000100:00100000:2.0:1788571992.935231:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495218816 00000100:00100000:2.0:1788571992.935382:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495218688 00000100:00100000:2.0:1788571992.935386:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495218688 00000100:00100000:2.0:1788571992.935406:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788571992.935416:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495218816:12345-192.168.202.2@tcp:400: 00000100:00100000:2.0:1788571992.935485:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495218816:12345-192.168.202.2@tcp:400: Request processed in 71us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571992.935492:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788571992.935509:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788571992.935516:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495218688:12345-192.168.202.2@tcp:400: 00000100:00100000:2.0:1788571992.935538:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495218688:12345-192.168.202.2@tcp:400: Request processed in 23us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571992.935544:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00080000:3.0:1788571992.936139:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788571992.936151:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1788571992.936455:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788571992.936461:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c07bb14000 from 39 10000000:01000000:2.0:1788571992.936465:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788571992.936499:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.936510:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.936522:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571992.936543:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518311680:0@lo:101: 00000100:00100000:2.0:1788571992.936588:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.936632:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.936701:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518311680 00000100:00100000:3.0:1788571992.936706:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518311680 00000100:00100000:3.0:1788571992.936743:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788571992.936751:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+12:5827:x1875453518311680:12345-0@lo:101: 00010000:00010000:3.0:1788571992.936771:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571992.936785:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c040030200/0x977d9e7969bff5ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff5a6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.936806:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c040030200/0x977d9e7969bff5ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff5a6 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.937000:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c040030200/0x977d9e7969bff5ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff5a6 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.937013:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030200, rc 0) 00000100:00100000:3.0:1788571992.937216:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518311680:12345-0@lo:101: Request processed in 465us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.937223:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788571992.937443:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518311680:0@lo:101: 00010000:00010000:1.0:1788571992.937458:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571992.937468:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571992.937525:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076237480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518311808:0@lo:501: 00000100:00100000:1.0:1788571992.937552:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571992.937580:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048000 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.937984:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518311808 00000100:00100000:3.0:1788571992.937990:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518311808 00000100:00100000:3.0:1788571992.938022:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788571992.938030:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518311808:12345-0@lo:501: 00000100:00100000:3.0:1788571992.938604:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518311808:12345-0@lo:501: Request processed in 573us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.938612:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788571992.938842:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076237480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518311808:0@lo:501: 00000100:00100000:2.0:1788571992.938887:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518311936:0@lo:503: 00000100:00100000:2.0:1788571992.938928:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.938958:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.939066:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518311936 00000100:00100000:3.0:1788571992.939071:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518311936 00000100:00100000:3.0:1788571992.939101:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788571992.939115:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518311936:12345-0@lo:503: 00000100:00100000:3.0:1788571992.939294:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518311936:12345-0@lo:503: Request processed in 179us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.939300:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788571992.939449:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518311936:0@lo:503: 00000100:00100000:0.0:1788571992.939898:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8458:1875453518312064:0@lo:502: 00000100:00100000:0.0:1788571992.939934:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571992.939964:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.940067:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518312064 00000100:00100000:3.0:1788571992.940072:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518312064 00000100:00100000:3.0:1788571992.940101:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788571992.940107:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:8458:x1875453518312064:12345-0@lo:502: 00000100:00100000:3.0:1788571992.940288:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:8458:x1875453518312064:12345-0@lo:502: Request processed in 180us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.940294:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788571992.940468:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8458:1875453518312064:0@lo:502: 00000100:00100000:0.0:1788571992.940503:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8458:1875453518312192:0@lo:502: 00000100:00100000:0.0:1788571992.940531:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571992.940556:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788571992.940901:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518312192 00000100:00100000:2.0:1788571992.940907:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518312192 00000100:00100000:2.0:1788571992.940941:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788571992.940949:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:8458:x1875453518312192:12345-0@lo:502: 00000100:00100000:2.0:1788571992.941422:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:8458:x1875453518312192:12345-0@lo:502: Request processed in 473us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571992.941429:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788571992.941576:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8458:1875453518312192:0@lo:502: 00000040:00080000:0.0:1788571992.941600:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788571992.942517:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788571992.942543:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788571992.942553:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.942564:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571992.942574:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788571992.942577:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788571992.942579:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788571992.942610:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.942618:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.942626:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571992.942653:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518312320:0@lo:101: 00000100:00100000:2.0:1788571992.942708:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.942745:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788571992.942959:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518312320 00000100:00100000:0.0:1788571992.942965:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518312320 00000100:00100000:0.0:1788571992.943005:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788571992.943014:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+13:5827:x1875453518312320:12345-0@lo:101: 00010000:00010000:0.0:1788571992.943026:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571992.943038:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b91400/0x977d9e7969bff5bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff5b4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571992.943072:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b91400/0x977d9e7969bff5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff5b4 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571992.943082:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b91400/0x977d9e7969bff5bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff5b4 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571992.943091:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91400, rc 0) 00000100:00100000:0.0:1788571992.943129:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518312320:12345-0@lo:101: Request processed in 117us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571992.943136:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788571992.943177:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518312320:0@lo:101: 00010000:00010000:0.0:1788571992.943190:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571992.943210:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571992.943281:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518312448:0@lo:501: 00000100:00100000:0.0:1788571992.943307:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571992.943339:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.943575:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518312448 00000100:00100000:3.0:1788571992.943581:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518312448 00000100:00100000:3.0:1788571992.943612:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788571992.943620:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518312448:12345-0@lo:501: 00000100:00100000:3.0:1788571992.944102:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518312448:12345-0@lo:501: Request processed in 425us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.944109:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788571992.944414:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518312448:0@lo:501: 00000100:00100000:0.0:1788571992.944445:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518312576:0@lo:503: 00000100:00100000:0.0:1788571992.944486:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571992.944518:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.944587:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518312576 00000100:00100000:3.0:1788571992.944592:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518312576 00000100:00100000:3.0:1788571992.944623:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788571992.944630:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518312576:12345-0@lo:503: 00000100:00100000:3.0:1788571992.945217:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518312576:12345-0@lo:503: Request processed in 585us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.945224:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788571992.945521:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518312576:0@lo:503: 00000100:00100000:2.0:1788571992.946997:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8459:1875453518312704:0@lo:502: 00000100:00100000:2.0:1788571992.947123:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.947190:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788571992.947232:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518312704 00000100:00100000:0.0:1788571992.947237:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518312704 00000100:00100000:0.0:1788571992.947440:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788571992.947450:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:8459:x1875453518312704:12345-0@lo:502: 00000100:00100000:0.0:1788571992.947689:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:8459:x1875453518312704:12345-0@lo:502: Request processed in 240us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571992.947696:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788571992.948001:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8459:1875453518312704:0@lo:502: 00000020:01000000:3.0:1788571992.948035:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788571992.948105:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788571992.948108:0:8459:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788571992.948117:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788571992.948143:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8459:1875453518312832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788571992.948177:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571992.948274:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04703ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788571992.948341:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518312832 00000100:00100000:0.0:1788571992.948346:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518312832 00000100:00100000:0.0:1788571992.948376:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788571992.948383:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:8459:x1875453518312832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788571992.948509:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:8459:x1875453518312832:12345-0@lo:502:llog_process_th.0 Request processed in 126us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571992.948524:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788571992.948671:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8459:1875453518312832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788571992.948703:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788571992.948708:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788571992.948710:0:8459:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788571992.948714:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788571992.949244:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788571992.949291:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788571992.949301:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.949313:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571992.949322:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788571992.949325:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c0503c8800 from 39 10000000:01000000:2.0:1788571992.949327:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788571992.949354:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.949362:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.949371:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571992.949387:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518312960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.949423:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.949459:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.949589:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518312960 00000100:00100000:3.0:1788571992.949594:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518312960 00000100:00100000:3.0:1788571992.949628:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788571992.949636:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:5827:x1875453518312960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788571992.949646:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571992.949658:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c040031000/0x977d9e7969bff5c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff5c2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.949691:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c040031000/0x977d9e7969bff5c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff5c2 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.949702:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c040031000/0x977d9e7969bff5c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff5c2 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.949710:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040031000, rc 0) 00000100:00100000:3.0:1788571992.949739:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518312960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.949770:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788571992.949854:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518312960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788571992.949876:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.949886:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571992.949926:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.949950:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.949972:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.951000:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518313088 00000100:00100000:3.0:1788571992.951008:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518313088 00000100:00100000:3.0:1788571992.951059:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788571992.951067:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518313088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788571992.951332:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518313088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.951339:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788571992.951486:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.951521:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.951563:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.951591:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.953360:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518313216 00000100:00100000:3.0:1788571992.953372:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518313216 00000100:00100000:3.0:1788571992.953418:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788571992.953427:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518313216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788571992.953624:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518313216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.953631:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788571992.953761:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788571992.958377:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8460:1875453518313344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788571992.958465:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571992.958511:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0537aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788571992.958574:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518313344 00000100:00100000:2.0:1788571992.958581:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518313344 00000100:00100000:2.0:1788571992.958627:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788571992.958636:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:8460:x1875453518313344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788571992.958892:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:8460:x1875453518313344:12345-0@lo:502:llog_process_th.0 Request processed in 256us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571992.958900:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788571992.961086:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8460:1875453518313344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788571992.961176:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8460:1875453518313472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788571992.961239:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571992.961305:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048600 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.962008:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518313472 00000100:00100000:3.0:1788571992.962016:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518313472 00000100:00100000:3.0:1788571992.962075:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788571992.962085:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:8460:x1875453518313472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788571992.962346:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:8460:x1875453518313472:12345-0@lo:502:llog_process_th.0 Request processed in 263us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.962354:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788571992.964934:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8460:1875453518313472:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788571992.964982:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788571992.965457:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788571992.965478:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788571992.965489:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.965515:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788571992.965525:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788571992.965528:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788571992.965531:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788571992.965565:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.965572:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.965581:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571992.965600:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.965659:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.965706:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.966991:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518313600 00000100:00100000:3.0:1788571992.967003:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518313600 00000100:00100000:3.0:1788571992.967061:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788571992.967071:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:5827:x1875453518313600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788571992.967085:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788571992.967099:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c040030a00/0x977d9e7969bff5d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff5d0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.967124:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c040030a00/0x977d9e7969bff5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff5d0 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.967135:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c040030a00/0x977d9e7969bff5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff5d0 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.967144:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030a00, rc 0) 00000100:00100000:3.0:1788571992.967208:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518313600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.967215:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788571992.967501:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788571992.967516:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.967526:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788571992.967580:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.967608:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.967656:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788571992.967708:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518313728 00000100:00100000:0.0:1788571992.967713:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518313728 00000100:00100000:0.0:1788571992.967747:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788571992.967754:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518313728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788571992.968014:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518313728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571992.968021:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788571992.969354:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.969408:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.969480:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.969516:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788571992.969918:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518313856 00000100:00100000:0.0:1788571992.969925:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518313856 00000100:00100000:0.0:1788571992.969968:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788571992.969977:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518313856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788571992.970164:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518313856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571992.970172:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788571992.971403:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518313856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788571992.972136:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8461:1875453518313984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788571992.972212:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571992.972288:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048840 going to sleep for 11 seconds 00000100:00100000:2.0:1788571992.972412:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518313984 00000100:00100000:2.0:1788571992.972417:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518313984 00000100:00100000:2.0:1788571992.972450:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788571992.972459:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:8461:x1875453518313984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788571992.972663:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:8461:x1875453518313984:12345-0@lo:502:llog_process_th.0 Request processed in 205us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571992.972671:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788571992.973349:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8461:1875453518313984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788571992.973376:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788571992.973386:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571992.973388:0:8461:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788571992.973396:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788571992.973420:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8461:1875453518314112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788571992.973457:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571992.973491:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048840 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.973840:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518314112 00000100:00100000:3.0:1788571992.973846:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518314112 00000100:00100000:3.0:1788571992.973891:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788571992.973899:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:8461:x1875453518314112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788571992.974067:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:8461:x1875453518314112:12345-0@lo:502:llog_process_th.0 Request processed in 169us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.974074:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788571992.975498:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8461:1875453518314112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788571992.975535:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788571992.975543:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788571992.975552:0:8461:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788571992.975557:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788571992.975746:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788571992.977148:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788571992.977160:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.977181:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571992.977191:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788571992.977194:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c065ad2800 from 39 10000000:01000000:3.0:1788571992.977197:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788571992.977228:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.977235:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.977244:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571992.977277:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518314240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788571992.977330:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571992.977381:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0537aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788571992.977526:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518314240 00000100:00100000:2.0:1788571992.977533:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518314240 00000100:00100000:2.0:1788571992.977574:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788571992.977583:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518314240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788571992.977594:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788571992.977605:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041523600/0x977d9e7969bff5e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff5de expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.977626:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041523600/0x977d9e7969bff5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff5de expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.977635:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041523600/0x977d9e7969bff5e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff5de expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571992.977655:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041523600, rc 0) 00000100:00100000:2.0:1788571992.977697:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518314240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571992.977703:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788571992.979532:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518314240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788571992.979555:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571992.979567:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571992.979638:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518314368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788571992.979681:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571992.979709:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048840 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.979787:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518314368 00000100:00100000:3.0:1788571992.979792:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518314368 00000100:00100000:3.0:1788571992.979833:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788571992.979843:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518314368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788571992.980098:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518314368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.980105:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788571992.980451:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518314368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788571992.980480:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518314496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788571992.980520:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571992.980544:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048840 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.981179:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518314496 00000100:00100000:3.0:1788571992.981185:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518314496 00000100:00100000:3.0:1788571992.981220:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788571992.981235:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518314496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788571992.981414:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518314496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.981421:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788571992.982503:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518314496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.983131:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8462:1875453518314624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788571992.983184:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.983221:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.983350:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518314624 00000100:00100000:3.0:1788571992.983356:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518314624 00000100:00100000:3.0:1788571992.983397:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788571992.983405:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:8462:x1875453518314624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788571992.983613:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:8462:x1875453518314624:12345-0@lo:502:llog_process_th.0 Request processed in 208us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.983620:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788571992.983957:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8462:1875453518314624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788571992.983998:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8462:1875453518314752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788571992.984029:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.984070:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788571992.986894:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518314752 00000100:00100000:3.0:1788571992.986910:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518314752 00000100:00100000:3.0:1788571992.986974:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788571992.986983:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:8462:x1875453518314752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788571992.987470:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:8462:x1875453518314752:12345-0@lo:502:llog_process_th.0 Request processed in 487us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571992.987478:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788571992.994730:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8462:1875453518314752:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788571992.994789:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788571992.995559:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788571992.995583:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788571992.995593:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.995605:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571992.995615:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788571992.995630:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788571992.995633:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788571992.995669:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.995692:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571992.995701:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571992.995723:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518314880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788571992.995792:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571992.995844:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04a24ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788571992.996291:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518314880 00000100:00100000:0.0:1788571992.996300:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518314880 00000100:00100000:0.0:1788571992.996346:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788571992.996355:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518314880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788571992.996368:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571992.996381:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff5f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff5ec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571992.996405:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff5f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff5ec expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571992.996424:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff5f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff5ec expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571992.996442:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91a00, rc 0) 00000100:00100000:0.0:1788571992.996491:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518314880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571992.996499:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788571992.996639:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518314880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788571992.996654:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571992.996664:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788571992.996729:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518315008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788571992.996757:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571992.996790:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048840 going to sleep for 11 seconds 00000100:00100000:2.0:1788571992.997006:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518315008 00000100:00100000:2.0:1788571992.997011:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518315008 00000100:00100000:2.0:1788571992.997055:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788571992.997064:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518315008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.997338:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518315008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571992.997345:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788571992.997376:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518315008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.997404:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518315136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.997452:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.997473:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788571992.997484:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518315136 00000100:00100000:2.0:1788571992.997488:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518315136 00000100:00100000:2.0:1788571992.997504:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788571992.997509:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518315136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.997642:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518315136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571992.997648:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788571992.997693:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518315136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788571992.998246:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8463:1875453518315264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788571992.998345:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571992.998409:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788571993.003799:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518315264 00000100:00100000:1.0:1788571993.003814:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518315264 00000100:00100000:2.0:1788571993.004965:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788571993.004981:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8463:x1875453518315264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788571993.005296:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8463:x1875453518315264:12345-0@lo:502:llog_process_th.0 Request processed in 319us (6948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571993.005303:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788571993.012771:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8463:1875453518315264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788571993.012811:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788571993.012833:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571993.012835:0:8463:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788571993.012843:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788571993.012891:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8463:1875453518315392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788571993.012965:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571993.013006:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788571993.013171:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518315392 00000100:00100000:3.0:1788571993.013178:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518315392 00000100:00100000:3.0:1788571993.013227:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788571993.013237:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8463:x1875453518315392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788571993.013493:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8463:x1875453518315392:12345-0@lo:502:llog_process_th.0 Request processed in 257us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571993.013500:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788571993.014826:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8463:1875453518315392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788571993.014871:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788571993.014879:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788571993.014881:0:8463:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788571993.014887:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788571993.015158:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788571993.015180:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788571993.015190:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571993.015200:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788571993.015209:0:5827:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788571993.015221:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88c04750cd40 from 1 10000000:01000000:3.0:1788571993.015224:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788571993.015280:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571993.015290:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788571993.015298:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788571993.015316:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518315520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788571993.015362:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571993.015390:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050b0de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788571993.015785:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518315520 00000100:00100000:2.0:1788571993.015792:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518315520 00000100:00100000:2.0:1788571993.015841:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788571993.015850:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518315520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788571993.015868:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788571993.015881:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041522600/0x977d9e7969bff601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff5fa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571993.015904:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041522600/0x977d9e7969bff601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff5fa expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571993.015924:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041522600/0x977d9e7969bff601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff5fa expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788571993.015932:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041522600, rc 0) 00000100:00100000:2.0:1788571993.015976:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518315520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571993.015981:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788571993.016286:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518315520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788571993.016300:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff601 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571993.016308:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff601 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788571993.016379:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518315648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788571993.016408:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571993.016421:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518315648 00000100:00100000:3.0:1788571993.016425:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518315648 00000100:00100000:0.0:1788571993.016432:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788571993.016469:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788571993.016476:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518315648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788571993.016702:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518315648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (292us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788571993.016706:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518315648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788571993.016710:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 10000000:01000000:0.0:1788571993.016726:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788571993.016732:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff601 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571993.016739:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff601 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571993.833278:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788571994.856401:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788571995.880960:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571996.264571:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518315776:0@lo:400:kworker.0 00000100:00100000:3.0:1788571996.264617:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518315904:0@lo:400:kworker.0 00000100:00100000:0.0:1788571996.264718:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518316160:0@lo:400:kworker.0 00000100:00100000:2.0:1788571996.271534:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518316032:0@lo:400:kworker.0 00000100:00100000:1.0:1788571996.271648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571996.271708:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518316288:0@lo:400:kworker.0 00000100:00100000:1.0:1788571996.271748:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571996.271806:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518316288 00000100:00100000:1.0:1788571996.271814:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518316288 00000100:00100000:1.0:1788571996.271868:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788571996.271877:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518316288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788571996.271929:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518316288:12345-0@lo:400:kworker.0 Request processed in 53us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571996.271936:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788571996.271955:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788571996.271983:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518316288:0@lo:400:kworker.0 00000100:00100000:1.0:1788571996.272013:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518315776 00000100:00100000:1.0:1788571996.272017:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518315776 00000100:00100000:1.0:1788571996.272042:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788571996.272048:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518315776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788571996.272375:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518315776:12345-0@lo:400:kworker.0 Request processed in 326us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571996.272383:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788571996.272414:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518315776:0@lo:400:kworker.0 00000100:00100000:0.0:1788571996.272520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571996.272669:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518316160 00000100:00100000:1.0:1788571996.272686:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518316160 00000100:00100000:1.0:1788571996.272719:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788571996.272726:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518316160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788571996.277578:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571996.277675:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518315904 00000100:00100000:3.0:1788571996.277687:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518315904 00000100:00100000:3.0:1788571996.277768:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788571996.277779:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518315904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788571996.278068:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518315904:12345-0@lo:400:kworker.0 Request processed in 289us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571996.278088:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788571996.278138:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788571996.278246:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788571996.278404:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518316032 00000100:00100000:3.0:1788571996.278409:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518316032 00000100:00100000:3.0:1788571996.278455:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788571996.278462:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518316032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788571996.278500:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518316032:12345-0@lo:400:kworker.0 Request processed in 38us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788571996.278506:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788571996.278894:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788571996.279837:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518316160:12345-0@lo:400:kworker.0 Request processed in 34us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571996.279856:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788571996.280655:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c04754fb80 x1875453518316160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571996.280672:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518316160:0@lo:400:kworker.0 00000100:00100000:3.0:1788571996.280996:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518315904:0@lo:400:kworker.0 00000100:00100000:3.0:1788571996.281007:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518316416:0@lo:400:kworker.0 00000100:00100000:3.0:1788571996.281063:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788571996.281210:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518316416 00000100:00100000:0.0:1788571996.281217:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518316416 00000100:00100000:0.0:1788571996.281301:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788571996.281311:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518316416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788571996.281368:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518316416:12345-0@lo:400:kworker.0 Request processed in 60us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571996.281375:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788571996.281404:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679500 x1875453518316416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788571996.281428:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518316416:0@lo:400:kworker.0 00000100:00100000:2.0:1788571996.281939:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518316032:0@lo:400:kworker.0 00000100:00080000:3.0:1788571996.282000:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788571996.776823:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518316544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788571996.776906:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788571996.780137:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518316544 00000100:00100000:1.0:1788571996.780153:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518316544 00000100:00100000:1.0:1788571996.780225:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788571996.780236:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518316544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788571996.780311:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788571996.780404:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518316544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (3508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571996.780412:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788571996.780677:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679f80 x1875453518316544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788571996.780697:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518316544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788571996.905129:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788571997.289796:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788571997.289821:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518316672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788571997.289887:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788571997.291355:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518316672 00000100:00100000:2.0:1788571997.291370:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518316672 00000100:00100000:2.0:1788571997.291429:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788571997.291440:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518316672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788571997.291482:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788571997.291562:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518316672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571997.291570:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788571997.291821:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679f80 x1875453518316672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788571997.291843:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518316672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788571997.929013:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788571998.037021:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788571998.037065:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571998.037206:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495218944 00000100:00100000:0.0:1788571998.037215:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495218944 00000100:00100000:0.0:1788571998.037292:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:0.0:1788571998.037301:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+8:2355:x1875453495218944:12345-192.168.202.2@tcp:400: 00000100:00100000:0.0:1788571998.037366:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+8:2355:x1875453495218944:12345-192.168.202.2@tcp:400: Request processed in 66us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571998.037372:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:1.0:1788571998.037911:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495219072 00000100:00100000:1.0:1788571998.037918:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495219072 00000100:00100000:1.0:1788571998.037983:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:1.0:1788571998.037991:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495219072:12345-192.168.202.2@tcp:400: 00000100:00100000:1.0:1788571998.038027:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495219072:12345-192.168.202.2@tcp:400: Request processed in 37us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571998.038034:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:3.0:1788571998.038394:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571998.038507:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495219200 00000100:00100000:1.0:1788571998.038512:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495219200 00000100:00100000:1.0:1788571998.038561:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1788571998.038569:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495219200:12345-192.168.202.2@tcp:400: 00000100:00100000:1.0:1788571998.038606:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495219200:12345-192.168.202.2@tcp:400: Request processed in 38us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571998.038613:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00080000:2.0:1788571998.038802:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788571998.038813:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788571998.039978:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571998.040066:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495219328 00000100:00100000:1.0:1788571998.040083:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495219328 00000100:00100000:1.0:1788571998.040147:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:1.0:1788571998.040157:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495219328:12345-192.168.202.2@tcp:400: 00000100:00080000:2.0:1788571998.040189:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788571998.040212:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495219328:12345-192.168.202.2@tcp:400: Request processed in 57us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571998.040220:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00010000:00010000:1.0:1788571998.953050:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788571999.060348:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571999.060446:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495219456 00000100:00100000:1.0:1788571999.060456:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495219456 00000100:00100000:1.0:1788571999.060510:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:1.0:1788571999.060520:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+8:5597:x1875453495219456:12345-192.168.202.2@tcp:101: 00010000:00010000:1.0:1788571999.060535:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788571999.060551:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10d80 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571999.060580:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d80 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571999.060591:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d80 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788571999.060599:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2c00, rc 0) 00000100:00100000:1.0:1788571999.060663:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5597:x1875453495219456:12345-192.168.202.2@tcp:101: Request processed in 144us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571999.060669:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:3.0:1788571999.066549:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788571999.066693:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495219584 00000100:00100000:2.0:1788571999.066704:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495219584 00000100:00100000:2.0:1788571999.066768:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 168 00000100:00100000:2.0:1788571999.066778:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5597:x1875453495219584:12345-192.168.202.2@tcp:501: 00000100:00100000:2.0:1788571999.067185:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5597:x1875453495219584:12345-192.168.202.2@tcp:501: Request processed in 407us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788571999.067194:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 168 00000100:00100000:3.0:1788571999.080528:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571999.082830:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495219712 00000100:00100000:0.0:1788571999.082846:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495219712 00000100:00100000:0.0:1788571999.082916:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 169 00000100:00100000:0.0:1788571999.082927:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5597:x1875453495219712:12345-192.168.202.2@tcp:503: 00000100:00100000:0.0:1788571999.083431:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5597:x1875453495219712:12345-192.168.202.2@tcp:503: Request processed in 505us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571999.083439:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 169 00000100:00100000:0.0:1788571999.091311:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788571999.095416:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495219840 00000100:00100000:1.0:1788571999.095431:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495219840 00000100:00100000:1.0:1788571999.095498:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 170 00000100:00100000:1.0:1788571999.095508:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+9:6099:x1875453495219840:12345-192.168.202.2@tcp:502: 00000100:00100000:1.0:1788571999.100474:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+9:6099:x1875453495219840:12345-192.168.202.2@tcp:502: Request processed in 4957us (9165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788571999.100489:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 170 00000100:00100000:3.0:1788571999.103658:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571999.103773:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495219968 00000100:00100000:0.0:1788571999.103782:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495219968 00000100:00100000:0.0:1788571999.103834:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:0.0:1788571999.103844:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+9:6099:x1875453495219968:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788571999.105373:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+9:6099:x1875453495219968:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 1522us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571999.105396:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:1.0:1788571999.120360:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571999.124599:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495220096 00000100:00100000:0.0:1788571999.124613:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495220096 00000100:00100000:0.0:1788571999.124680:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:0.0:1788571999.124691:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5597:x1875453495220096:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788571999.124707:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788571999.124734:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b91c00/0x977d9e7969bff60f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10d87 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571999.124775:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b91c00/0x977d9e7969bff60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d87 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571999.124785:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b91c00/0x977d9e7969bff60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d87 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788571999.124795:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91c00, rc 0) 00000100:00100000:0.0:1788571999.124866:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5597:x1875453495220096:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 176us (4515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788571999.124874:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:2.0:1788571999.133161:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788571999.133680:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495220224 00000100:00100000:0.0:1788571999.133692:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495220224 00000100:00100000:0.0:1788571999.133769:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 173 00000100:00100000:0.0:1788571999.133779:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5597:x1875453495220224:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788571999.134461:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5597:x1875453495220224:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 681us (1307us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788571999.134471:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 173 00010000:00010000:3.0:1788571999.976460:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572000.804971:0:8502:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8b86eba0 20000000:00000080:0.0:1788572000.804988:0:8502:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88c07ba79000 uarg=0000000000000000 20000000:01000000:0.0:1788572000.805021:0:8502:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788572000.805027:0:8502:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788572000.805032:0:8502:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788572000.807453:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788572000.807606:0:8502:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788572000.815214:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788572000.815316:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788572000.815372:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788572000.815390:0:8502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788572000.815409:0:8502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.815426:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c040031e00/0x977d9e7969bff38b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff384 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.815435:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff3e6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.815442:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff4b1 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.815453:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d4f expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.815469:0:8502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.815507:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d4f expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.815524:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d4f expref: 9 pid: 5824 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572000.815539:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875453518316800:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572000.815828:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff4b1 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.815836:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff4b1 expref: 18 pid: 5824 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572000.815845:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875453518316928:0@lo:104: 00000100:00100000:1.0:1788572000.815888:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572000.816385:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff3e6 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.816395:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff3e6 expref: 18 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572000.816405:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875453518317056:0@lo:104: 00000100:00100000:1.0:1788572000.816434:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572000.825391:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c040031e00/0x977d9e7969bff38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff384 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.825412:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c040031e00/0x977d9e7969bff38b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff384 expref: 18 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572000.825427:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875453518317184:0@lo:104: 00000100:00100000:0.0:1788572000.825477:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572000.829160:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788572000.829232:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572000.829756:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518316928 00000100:00100000:3.0:1788572000.829767:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518316928 00000100:00100000:3.0:1788572000.829817:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518317056 00000100:00100000:3.0:1788572000.829821:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518317056 00000100:00100000:3.0:1788572000.829831:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518317184 00000100:00100000:3.0:1788572000.829834:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518317184 00000100:00100000:3.0:1788572000.829847:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788572000.829856:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:8502:x1875453518316928:12345-0@lo:104: 00010000:00010000:3.0:1788572000.829876:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.831445:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572000.831461:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:8502:x1875453518316928:12345-0@lo:104: Request processed in 1602us (15569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572000.831471:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788572000.831507:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788572000.831522:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076e73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:8502:x1875453518317056:12345-0@lo:104: 00010000:00010000:3.0:1788572000.831537:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572000.831663:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:2.0:1788572000.831669:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788572000.831677:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1788572000.833143:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875453518316928:0@lo:104: 00000100:00100000:0.0:1788572000.833158:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875453518317056:0@lo:104: 00010000:00010000:1.0:1788572000.836572:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572000.836588:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.836617:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:1.0:1788572000.836621:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.836630:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572000.836637:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572000.836643:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788572000.836770:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.836777:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572000.837013:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.837023:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b91200/0x977d9e7969bff4b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff4b8 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.837040:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572000.837044:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572000.837053:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518317312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572000.837059:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387400 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572000.837062:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.837068:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572000.837074:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572000.837078:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788572000.837091:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.837096:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788572000.837118:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572000.837119:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.837125:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387400/0x977d9e7969bff3e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff3ed expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.837133:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572000.837135:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572000.837137:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572000.837176:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518317312 00000100:00100000:0.0:1788572000.837182:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518317312 00010000:00010000:0.0:1788572000.837211:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff4b1 expref: 19 pid: 5824 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572000.837264:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788572000.837280:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518317312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572000.837293:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572000.837308:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff4b1 expref: 19 pid: 5824 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.837319:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff4b1 expref: 19 pid: 5824 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.837333:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387600/0x977d9e7969bff4b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff4b1 expref: 19 pid: 5824 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.837346:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572000.837393:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3300:x1875453518317312:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572000.837399:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788572000.837422:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572000.837429:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518317440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572000.837489:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572000.837525:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518317440 00000100:00100000:1.0:1788572000.837530:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518317440 00010000:00010000:1.0:1788572000.837546:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff3e6 expref: 18 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572000.837565:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788572000.837571:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3298:x1875453518317440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572000.837578:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572000.837582:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff3e6 expref: 18 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.837590:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff3e6 expref: 18 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.837600:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041386800/0x977d9e7969bff3ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff3e6 expref: 18 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.837610:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572000.837645:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3298:x1875453518317440:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572000.837651:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788572000.837672:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518317312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572000.837673:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518317440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572000.838430:0:8504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788572000.838442:0:8504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:8502:x1875453518317184:12345-0@lo:104: 00010000:00010000:0.0:1788572000.838454:0:8504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572000.838639:0:8504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572000.838645:0:8504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:8502:x1875453518317184:12345-0@lo:104: Request processed in 207us (9415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572000.838652:0:8504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788572000.841194:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875453518317184:0@lo:104: 00010000:00010000:3.0:1788572000.841272:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572000.841282:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076e73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:8502:x1875453518317056:12345-0@lo:104: Request processed in 9765us (24845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572000.841293:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788572000.841402:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572000.841409:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.841419:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db2a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:1.0:1788572000.841423:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.841433:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572000.841439:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572000.841445:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788572000.841496:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.841502:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572000.841520:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.841527:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff384 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff38b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572000.841559:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788572000.841562:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572000.841564:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572000.841565:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572000.841574:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518317568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572000.841630:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572000.841734:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518317568 00000100:00100000:1.0:1788572000.841741:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518317568 00010000:00010000:1.0:1788572000.841767:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c040031e00/0x977d9e7969bff38b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff384 expref: 17 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572000.841800:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788572000.841808:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3297:x1875453518317568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572000.841820:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572000.841825:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c040031e00/0x977d9e7969bff38b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff384 expref: 17 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.841835:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c040031e00/0x977d9e7969bff38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff384 expref: 17 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.841848:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040031e00/0x977d9e7969bff38b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff384 expref: 17 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572000.841860:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572000.841892:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3297:x1875453518317568:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572000.841918:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788572000.841986:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518317568:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572000.842052:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572000.843969:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572000.844078:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875453518316800:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572000.844116:0:8502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572000.845877:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495220352 00000100:00100000:3.0:1788572000.845893:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495220352 00010000:00010000:3.0:1788572000.846030:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d4f expref: 10 pid: 5824 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572000.846204:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:3.0:1788572000.846214:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2356:x1875453495220352:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572000.846229:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572000.846236:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d4f expref: 10 pid: 5824 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846277:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d4f expref: 10 pid: 5824 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846296:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030600/0x977d9e7969bff575 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d4f expref: 10 pid: 5824 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846317:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846326:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846343:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846351:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846358:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846366:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846383:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572000.846388:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846397:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846415:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572000.846426:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572000.846484:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+9:2356:x1875453495220352:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 271us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572000.846492:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00010000:00010000:2.0:1788572000.846562:0:8502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572000.846571:0:8502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572000.846578:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3400/0x977d9e7969bff616 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572001.002875:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572001.385050:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518317696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572001.385138:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572001.385368:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518317696 00000100:00100000:2.0:1788572001.385378:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518317696 00000100:00100000:2.0:1788572001.385432:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788572001.385441:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3299:x1875453518317696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572001.388919:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518317824:0@lo:400:kworker.0 00000100:00100000:0.0:1788572001.388990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.393561:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518317952:0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.393640:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.393719:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518317824 00000100:00100000:3.0:1788572001.393727:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518317824 00000100:00100000:3.0:1788572001.393773:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518317952 00000100:00100000:3.0:1788572001.393777:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518317952 00000100:00100000:3.0:1788572001.393804:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788572001.393813:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518317824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.394193:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518317824:12345-0@lo:400:kworker.0 Request processed in 380us (5201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.394201:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788572001.394220:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788572001.394229:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518317952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.394299:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518317952:12345-0@lo:400:kworker.0 Request processed in 73us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.394305:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788572001.394326:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572001.394360:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518317824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.394394:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518317952:0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.394431:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518318080:0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.394465:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.394500:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518318080 00000100:00100000:3.0:1788572001.394504:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518318080 00000100:00100000:3.0:1788572001.394538:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788572001.394545:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518318080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.394578:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518318080:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.394584:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788572001.394599:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788572001.394618:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0502f1500 x1875453518318080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572001.394628:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518318080:0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.394653:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572001.394658:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518318208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.394692:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.394710:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518318208 00000100:00100000:3.0:1788572001.394714:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518318208 00000100:00100000:3.0:1788572001.394737:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788572001.394751:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518318208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.394783:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518318208:12345-0@lo:400:kworker.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.394788:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788572001.394801:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572001.394818:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518318208:0@lo:400:kworker.0 00000100:00100000:2.0:1788572001.395634:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3299:x1875453518317696:12345-0@lo:400:kworker.0 Request processed in 10190us (10492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572001.395645:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788572001.397158:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518318336:0@lo:400:kworker.0 00000100:00100000:3.0:1788572001.397216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572001.397357:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518317696:0@lo:400:kworker.0 00000100:00100000:2.0:1788572001.399399:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518318336 00000100:00100000:2.0:1788572001.399414:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518318336 00000100:00080000:3.0:1788572001.399460:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572001.399483:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788572001.399494:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518318336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572001.399582:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518318336:12345-0@lo:400:kworker.0 Request processed in 89us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572001.399589:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788572001.401160:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679500 x1875453518318336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572001.401180:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518318336:0@lo:400:kworker.0 10000000:01000000:2.0:1788572001.897485:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788572001.897492:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c07bb14000 from 4 10000000:01000000:2.0:1788572001.897496:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572001.897526:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572001.897538:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572001.897549:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572001.897571:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518318592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572001.897640:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572001.897703:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05218d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572001.897749:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518318592 00000100:00100000:0.0:1788572001.897756:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518318592 00000100:00100000:0.0:1788572001.897807:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788572001.897816:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518318592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572001.897829:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572001.897842:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff61d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572001.897863:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff61d expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572001.897874:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff61d expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572001.897883:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90000, rc 0) 00000100:00100000:0.0:1788572001.897925:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518318592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572001.897931:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788572001.897975:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518318592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572001.897989:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572001.898004:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572001.898051:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518318720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572001.898076:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572001.898090:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076587f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572001.898102:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518318720 00000100:00100000:0.0:1788572001.898105:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518318720 00000100:00100000:0.0:1788572001.898125:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788572001.898130:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518318720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572001.898379:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518318720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572001.898385:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788572001.898415:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518318720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572001.898439:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518318848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572001.898472:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572001.898484:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076587f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572001.898494:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518318848 00000100:00100000:0.0:1788572001.898497:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518318848 00000100:00100000:0.0:1788572001.898517:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788572001.898522:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518318848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572001.898654:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518318848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572001.898811:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788572001.898856:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518318848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572001.899047:0:8539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8539:1875453518318976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572001.899078:0:8539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572001.899096:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518318976 00000100:00100000:0.0:1788572001.899099:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518318976 00000100:00100000:0.0:1788572001.899118:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788572001.899123:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:8539:x1875453518318976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572001.899230:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:8539:x1875453518318976:12345-0@lo:502:llog_process_th.0 Request processed in 106us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572001.899236:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788572001.899287:0:8539:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076587000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572001.899298:0:8539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8539:1875453518318976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788572001.899317:0:8539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572001.899326:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572001.899329:0:8539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788572001.899336:0:8539:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c07bb14000 00000020:00000080:0.0:1788572001.899338:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788572001.901650:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518318464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572001.901729:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.901785:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518318464 00000100:00100000:3.0:1788572001.901792:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518318464 00000100:00100000:3.0:1788572001.901836:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788572001.901844:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518318464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572001.901878:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572001.901922:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518318464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.901928:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788572001.901967:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679500 x1875453518318464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572001.901985:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518318464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572001.902097:0:8539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8539:1875453518319104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572001.902136:0:8539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.902159:0:8539:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572001.902380:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518319104 00000100:00100000:2.0:1788572001.902385:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518319104 00000100:00100000:2.0:1788572001.902420:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788572001.902427:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:8539:x1875453518319104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572001.902621:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:8539:x1875453518319104:12345-0@lo:502:llog_process_th.0 Request processed in 194us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572001.902628:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788572001.902632:0:8539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8539:1875453518319104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572001.902653:0:8539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572001.902671:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572001.902673:0:8539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788572001.902679:0:8539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788572001.903302:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788572001.903321:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788572001.903331:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572001.903343:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572001.903353:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572001.903356:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c0503c8800 from 4 10000000:01000000:1.0:1788572001.903359:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572001.903386:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572001.903395:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572001.903404:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572001.903431:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518319232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572001.903465:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572001.903494:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572001.903511:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518319232 00000100:00100000:1.0:1788572001.903516:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518319232 00000100:00100000:1.0:1788572001.904747:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788572001.904757:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518319232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572001.904771:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572001.904785:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff62b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572001.904821:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff62b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572001.904832:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff62b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572001.904841:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db3000, rc 0) 00000100:00100000:1.0:1788572001.905183:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518319232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 425us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572001.905189:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788572001.905315:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518319232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572001.905332:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572001.905341:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572001.905401:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518319360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572001.905430:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572001.905460:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572001.905650:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518319360 00000100:00100000:3.0:1788572001.905656:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518319360 00000100:00100000:3.0:1788572001.905698:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788572001.905706:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518319360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.905933:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518319360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.905940:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788572001.905999:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518319360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.906027:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518319488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.906062:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.906077:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572001.906087:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518319488 00000100:00100000:3.0:1788572001.906090:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518319488 00000100:00100000:3.0:1788572001.906109:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788572001.906115:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518319488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.906233:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518319488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.906240:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788572001.906303:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518319488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.906459:0:8541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8541:1875453518319616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572001.906491:0:8541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.906514:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518319616 00000100:00100000:3.0:1788572001.906517:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518319616 00000100:00100000:3.0:1788572001.906537:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788572001.906543:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8541:x1875453518319616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572001.906650:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8541:x1875453518319616:12345-0@lo:502:llog_process_th.0 Request processed in 106us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.906656:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788572001.906693:0:8541:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572001.906704:0:8541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8541:1875453518319616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572001.906723:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572001.906732:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572001.906734:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788572001.906741:0:8541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c0503c8800 00000020:00000080:3.0:1788572001.906744:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788572001.906802:0:8541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8541:1875453518319744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572001.906833:0:8541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.906851:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518319744 00000100:00100000:3.0:1788572001.906855:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518319744 00000100:00100000:3.0:1788572001.906874:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788572001.906879:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8541:x1875453518319744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572001.906975:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:8541:x1875453518319744:12345-0@lo:502:llog_process_th.0 Request processed in 96us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.906981:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788572001.907012:0:8541:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572001.907024:0:8541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8541:1875453518319744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572001.907040:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572001.907048:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572001.907050:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788572001.907053:0:8541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788572001.907099:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788572001.907113:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572001.907121:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572001.907131:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572001.907139:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788572001.907141:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c065ad2800 from 4 10000000:01000000:3.0:1788572001.907144:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572001.907164:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572001.907171:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572001.907179:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572001.907190:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518319872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.907214:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.907228:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572001.907237:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518319872 00000100:00100000:3.0:1788572001.907240:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518319872 00000100:00100000:3.0:1788572001.907275:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788572001.907281:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518319872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572001.907288:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572001.907301:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff639 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572001.907317:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff639 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572001.907327:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff639 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572001.907334:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387000, rc 0) 00000100:00100000:3.0:1788572001.907358:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518319872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.907364:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788572001.907388:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518319872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572001.907398:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572001.907406:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572001.907439:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518320000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.907459:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.907474:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572001.907483:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518320000 00000100:00100000:3.0:1788572001.907485:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518320000 00000100:00100000:3.0:1788572001.907501:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788572001.907505:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518320000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.907671:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518320000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.907683:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788572001.907711:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518320000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.907733:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518320128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.907762:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572001.907775:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572001.907785:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518320128 00000100:00100000:3.0:1788572001.907788:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518320128 00000100:00100000:3.0:1788572001.907806:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788572001.907811:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518320128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572001.907903:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518320128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572001.907909:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788572001.907940:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518320128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572001.909556:0:8542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8542:1875453518320256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572001.909616:0:8542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572001.909671:0:8542:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572001.909694:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518320256 00000100:00100000:1.0:1788572001.909700:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518320256 00000100:00100000:1.0:1788572001.909752:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788572001.909762:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:8542:x1875453518320256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572001.910230:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:8542:x1875453518320256:12345-0@lo:502:llog_process_th.0 Request processed in 469us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572001.910238:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788572001.910299:0:8542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8542:1875453518320256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788572001.910327:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572001.910335:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572001.910337:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788572001.910344:0:8542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c065ad2800 00000020:00000080:0.0:1788572001.910346:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788572001.910421:0:8542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8542:1875453518320384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572001.910453:0:8542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572001.910474:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518320384 00000100:00100000:0.0:1788572001.910477:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518320384 00000100:00100000:0.0:1788572001.910498:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788572001.910504:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:8542:x1875453518320384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572001.910603:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:8542:x1875453518320384:12345-0@lo:502:llog_process_th.0 Request processed in 99us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572001.910610:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788572001.910643:0:8542:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c40db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572001.910654:0:8542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:8542:1875453518320384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572001.915135:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572001.915148:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572001.915151:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788572001.915157:0:8542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788572001.915214:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788572001.915233:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788572001.915268:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572001.915280:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572002.028309:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572002.394018:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572002.394149:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495220480 00000100:00100000:1.0:1788572002.394158:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495220480 00000100:00100000:1.0:1788572002.394218:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 190 00000100:00100000:1.0:1788572002.394230:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+9:5597:x1875453495220480:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572002.394281:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572002.394299:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10d8e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572002.394330:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d8e expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572002.394342:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d8e expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572002.394352:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2200, rc 0) 00000100:00100000:1.0:1788572002.397467:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5597:x1875453495220480:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 3227us (3457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572002.397479:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 190 00000100:00100000:2.0:1788572002.403536:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572002.403614:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495220608 00000100:00100000:1.0:1788572002.403623:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495220608 00000100:00100000:1.0:1788572002.403737:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 191 00000100:00100000:1.0:1788572002.403747:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5597:x1875453495220608:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572002.404211:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5597:x1875453495220608:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 463us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572002.404219:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 191 00000100:00100000:2.0:1788572002.415338:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518320512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572002.415405:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572002.415470:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518320512 00000100:00100000:2.0:1788572002.415478:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518320512 00000100:00100000:2.0:1788572002.415521:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788572002.415530:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518320512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572002.415563:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572002.415605:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518320512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572002.415611:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788572002.415664:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c075da7800 x1875453518320512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572002.415682:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518320512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572002.415829:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572002.415890:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495220736 00000100:00100000:2.0:1788572002.415894:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495220736 00000100:00100000:2.0:1788572002.415925:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:2.0:1788572002.415932:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5597:x1875453495220736:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572002.416146:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:5597:x1875453495220736:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 214us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572002.416155:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:2.0:1788572002.425320:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572002.425353:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495220864 00000100:00100000:2.0:1788572002.425362:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495220864 00000100:00100000:2.0:1788572002.425402:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 193 00000100:00100000:2.0:1788572002.425411:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:6162:x1875453495220864:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788572002.425684:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:6162:x1875453495220864:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 273us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572002.425692:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 193 00000100:00100000:2.0:1788572002.444413:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572002.444488:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495220992 00000100:00100000:3.0:1788572002.444498:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495220992 00000100:00100000:3.0:1788572002.444551:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:3.0:1788572002.444561:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:6162:x1875453495220992:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788572002.444850:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:6162:x1875453495220992:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 289us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572002.444858:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 194 00010000:00010000:3.0:1788572003.049392:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572003.162736:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572003.163177:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572003.163202:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572003.163276:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495221120 00000100:00100000:3.0:1788572003.163285:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495221120 00000100:00100000:3.0:1788572003.163344:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:3.0:1788572003.163363:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495221120:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572003.163428:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495221120:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 68us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572003.163436:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:3.0:1788572003.163458:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495221376 00000100:00100000:3.0:1788572003.163461:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495221376 00000100:00100000:3.0:1788572003.163613:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495221248 00000100:00100000:3.0:1788572003.163617:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495221248 00000100:00100000:3.0:1788572003.163634:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788572003.163649:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495221376:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572003.163726:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495221376:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 86us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572003.163732:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788572003.163742:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1788572003.163747:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495221248:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572003.163765:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495221248:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 18us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572003.163770:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00080000:3.0:1788572003.163783:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572003.163786:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572003.163789:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788572004.072917:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572005.096542:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572006.124702:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572006.505711:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518320768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.505781:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572006.505836:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518321280:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.505862:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572006.505892:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572006.505899:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518320640:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.505926:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572006.505947:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518321152:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.505966:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572006.505992:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518320896:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.506013:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572006.506032:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572006.506037:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518321024:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.506058:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572006.506088:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518320768 00000100:00100000:2.0:1788572006.506096:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518320768 00000100:00100000:2.0:1788572006.506136:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518321152 00000100:00100000:2.0:1788572006.506145:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518321152 00000100:00100000:2.0:1788572006.506172:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518320896 00000100:00100000:2.0:1788572006.506174:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518320896 00000100:00100000:2.0:1788572006.506191:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788572006.506198:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518320768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.506274:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518320768:12345-0@lo:400:kworker.0 Request processed in 50us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572006.506281:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788572006.506299:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572006.506305:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518321152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.506333:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518321152:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572006.506339:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572006.506350:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572006.506355:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518320896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.506383:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518320896:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572006.506388:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572006.506404:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518321280 00000100:00100000:2.0:1788572006.506407:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518321280 00000100:00100000:2.0:1788572006.508691:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518321024 00000100:00100000:2.0:1788572006.508702:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518321024 00000100:00100000:2.0:1788572006.508721:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788572006.508729:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518321280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.508805:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518321280:12345-0@lo:400:kworker.0 Request processed in 77us (2942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572006.508811:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788572006.508839:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788572006.508845:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518321024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.508879:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518321024:12345-0@lo:400:kworker.0 Request processed in 34us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572006.508884:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788572006.508904:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518320640 00000100:00100000:2.0:1788572006.508908:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518320640 00000100:00100000:2.0:1788572006.508942:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788572006.508949:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518320640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.508980:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518320640:12345-0@lo:400:kworker.0 Request processed in 31us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572006.508986:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1788572006.509024:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572006.509028:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572006.509030:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788572006.509063:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45197b80 x1875453518321024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572006.509077:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518321024:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.509091:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518320896:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.509125:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518320640:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.509139:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518321152:0@lo:400:kworker.0 00000100:00100000:2.0:1788572006.509151:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518320768:0@lo:400:kworker.0 00010000:00080000:2.0:1788572006.509162:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45197100 x1875453518321280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572006.509185:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518321280:0@lo:400:kworker.0 00000100:00100000:2.0:1788572007.025959:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572007.025980:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518321408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572007.026044:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572007.026102:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518321408 00000100:00100000:2.0:1788572007.026109:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518321408 00000100:00100000:2.0:1788572007.026290:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572007.026302:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518321408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572007.026339:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572007.026385:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518321408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572007.026391:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788572007.026440:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45197100 x1875453518321408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572007.026530:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518321408:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572007.145688:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572007.530078:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518321536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572007.530158:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572007.530240:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518321536 00000100:00100000:1.0:1788572007.530267:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518321536 00000100:00100000:1.0:1788572007.530317:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788572007.530326:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518321536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572007.530359:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572007.530417:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518321536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572007.530424:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788572007.530466:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c04754ed80 x1875453518321536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572007.530496:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518321536:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788572008.090231:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788572008.169683:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572008.282762:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572008.282850:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572008.282966:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495221632 00000100:00100000:0.0:1788572008.282977:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495221632 00000100:00100000:0.0:1788572008.283031:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:0.0:1788572008.283040:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495221632:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572008.283105:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495221632:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572008.283113:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00080000:3.0:1788572008.283349:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572008.283470:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495221504 00000100:00100000:2.0:1788572008.283475:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495221504 00000100:00100000:2.0:1788572008.283515:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:2.0:1788572008.283522:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2356:x1875453495221504:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572008.283565:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2356:x1875453495221504:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 44us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572008.283572:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:3.0:1788572008.286849:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572008.286897:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572008.287142:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495221760 00000100:00100000:0.0:1788572008.287151:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495221760 00000100:00100000:0.0:1788572008.287274:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495221888 00000100:00100000:0.0:1788572008.287284:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495221888 00000100:00100000:2.0:1788572008.287334:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1788572008.287347:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2352:x1875453495221760:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:2.0:1788572008.287388:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff583 00000100:00080000:2.0:1788572008.287399:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88c058aaf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572008.287438:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788572008.287772:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+2:2352:x1875453495221760:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 427us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572008.287779:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00010000:00010000:2.0:1788572008.287802:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572008.288166:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572008.288171:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572008.288296:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788572008.288305:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2352:x1875453495221888:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:0.0:1788572008.288325:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff58a 00000100:00080000:0.0:1788572008.288331:0:6681:0:(import.c:65:import_set_state_nolock()) ffff88c058aa9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572008.288355:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788572008.288581:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572008.288707:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+2:2352:x1875453495221888:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 403us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572008.288715:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00010000:00010000:0.0:1788572009.205905:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572010.218302:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572011.241374:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572011.626528:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518321792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572011.626648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572011.626745:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518322304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572011.626784:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572011.627548:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572011.627562:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518321664:0@lo:400:kworker.0 00000100:00100000:2.0:1788572011.627616:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572011.627652:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518322176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572011.627687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572011.628154:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518321920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572011.628198:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572011.628229:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572011.628236:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518322048:0@lo:400:kworker.0 00000100:00100000:2.0:1788572011.628280:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572011.628319:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518321792 00000100:00100000:2.0:1788572011.628328:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518321792 00000100:00100000:2.0:1788572011.628437:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518322176 00000100:00100000:2.0:1788572011.628456:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518322176 00000100:00100000:2.0:1788572011.628481:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518321920 00000100:00100000:2.0:1788572011.628483:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518321920 00000100:00100000:2.0:1788572011.628688:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572011.628699:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518321792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572011.628809:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518321792:12345-0@lo:400:kworker.0 Request processed in 103us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572011.628817:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572011.630331:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572011.630605:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518322176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572011.630692:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518322176:12345-0@lo:400:kworker.0 Request processed in 351us (3006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572011.630700:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572011.630741:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788572011.630749:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518321920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572011.631363:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518321664 00000100:00100000:3.0:1788572011.631396:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518321664 00000100:00100000:3.0:1788572011.631694:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788572011.631706:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518321664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572011.634319:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518321664:12345-0@lo:400:kworker.0 Request processed in 2604us (6692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572011.634334:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:3.0:1788572011.634414:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572011.634774:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518322304 00000100:00100000:0.0:1788572011.634786:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518322304 00000100:00100000:0.0:1788572011.635116:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518322048 00000100:00100000:0.0:1788572011.635124:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518322048 00000100:00100000:0.0:1788572011.635152:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788572011.635165:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518322304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572011.635232:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518322304:12345-0@lo:400:kworker.0 Request processed in 72us (8448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572011.635238:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788572011.635286:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572011.635297:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518322048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572011.635370:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518322048:12345-0@lo:400:kworker.0 Request processed in 52us (7065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572011.635377:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788572011.635433:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45195f80 x1875453518322048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572011.635451:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518322048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572011.635522:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518321664:0@lo:400:kworker.0 00000100:00100000:0.0:1788572011.635543:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518322176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572011.635559:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518321792:0@lo:400:kworker.0 00010000:00080000:0.0:1788572011.635574:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45195880 x1875453518322304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572011.635584:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45195880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518322304:0@lo:400:kworker.0 00000100:00080000:3.0:1788572011.636176:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572011.636182:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572011.638173:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518321920:12345-0@lo:400:kworker.0 Request processed in 7418us (9969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572011.638188:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788572011.638317:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518321920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572012.141186:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572012.141208:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518322432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572012.141299:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572012.143841:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518322432 00000100:00100000:1.0:1788572012.143916:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518322432 00000100:00100000:1.0:1788572012.143981:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788572012.143991:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518322432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572012.144028:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572012.144121:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518322432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572012.144129:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788572012.144178:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45197800 x1875453518322432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572012.144198:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518322432:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572012.264747:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572012.659690:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518322560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572012.659764:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572012.679592:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518322560 00000100:00100000:3.0:1788572012.679606:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518322560 00000100:00100000:2.0:1788572012.679989:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788572012.680002:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518322560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572012.680042:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572012.680166:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518322560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (20401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572012.680187:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788572012.680312:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076679500 x1875453518322560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572012.680334:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518322560:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788572012.763574:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:3.0:1788572012.763586:0:7635:0:(genops.c:885:class_export_put()) final put ffff88c058aa8800/78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:3.0:1788572012.763615:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c058aa8800/78708c10-ef63-4de2-8b1c-aff484c98227 for lustre-OST0001 00000020:00000080:3.0:1788572012.763664:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c058aa9000 for lustre-OST0001 00000001:00100000:1.0:1788572013.209673:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:1.0:1788572013.209681:0:6703:0:(genops.c:885:class_export_put()) final put ffff88c058aad000/78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:3.0:1788572013.209974:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c058aad000/78708c10-ef63-4de2-8b1c-aff484c98227 for lustre-OST0000 00000020:00000080:3.0:1788572013.210025:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c058aaf800 for lustre-OST0000 00010000:00010000:0.0:1788572013.293230:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572013.348065:0:9050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing yml_node 00000100:00100000:2.0:1788572013.400118:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572013.400171:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572013.400355:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495222144 00000100:00100000:1.0:1788572013.400366:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495222144 00000100:00100000:1.0:1788572013.400457:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:1.0:1788572013.400480:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495222144:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572013.400570:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495222144:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 93us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572013.400578:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00080000:1.0:1788572013.400603:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572013.401015:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495222016 00000100:00100000:3.0:1788572013.401021:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495222016 00000100:00100000:3.0:1788572013.401059:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:3.0:1788572013.401068:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495222016:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572013.401114:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495222016:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 47us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572013.401136:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 198 00010000:00010000:3.0:1788572014.332270:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572015.340771:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572016.361726:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572016.744917:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518322688:0@lo:400:kworker.0 00000100:00100000:0.0:1788572016.744960:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518323072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572016.745019:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518322816:0@lo:400:kworker.0 00000100:00100000:1.0:1788572016.745019:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518322944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572016.750297:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572016.750414:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518323072 00000100:00100000:0.0:1788572016.750424:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518323072 00000100:00100000:3.0:1788572016.751147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572016.751198:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518323200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572016.751240:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572016.751308:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518322688 00000100:00100000:3.0:1788572016.751313:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518322688 00000100:00100000:3.0:1788572016.751354:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788572016.751363:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518322688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572016.751429:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518322688:12345-0@lo:400:kworker.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572016.751436:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788572016.751482:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518322688:0@lo:400:kworker.0 00000100:00100000:3.0:1788572016.751515:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518323200 00000100:00100000:3.0:1788572016.751519:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518323200 00000100:00100000:3.0:1788572016.751565:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788572016.751571:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518323200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572016.751603:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518323200:12345-0@lo:400:kworker.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572016.751609:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788572016.751650:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518323200:0@lo:400:kworker.0 00000100:00080000:3.0:1788572016.751918:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572016.753451:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788572016.753465:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518323072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572016.753859:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518323072:12345-0@lo:400:kworker.0 Request processed in 397us (3570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572016.753866:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788572016.754613:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0765d2d80 x1875453518323072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572016.754650:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518323072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572016.758491:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572016.758552:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518323328:0@lo:400:kworker.0 00000100:00100000:2.0:1788572016.758584:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572016.758623:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518323328 00000100:00100000:2.0:1788572016.758630:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518323328 00000100:00100000:0.0:1788572016.758720:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518322816 00000100:00100000:0.0:1788572016.758724:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518322816 00000100:00100000:0.0:1788572016.758773:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572016.758783:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518322816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572016.758851:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518322816:12345-0@lo:400:kworker.0 Request processed in 68us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572016.758859:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788572016.764463:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572016.766395:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518322944 00000100:00100000:0.0:1788572016.766420:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518322944 00000100:00080000:3.0:1788572016.766600:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572016.766618:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572016.766620:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572016.766696:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518322816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572016.767166:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788572016.767179:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518323328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572016.767282:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518323328:12345-0@lo:400:kworker.0 Request processed in 106us (8697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572016.767290:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788572016.767336:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0765d3b80 x1875453518323328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572016.767349:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518323328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572016.772195:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788572016.772213:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518322944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572016.773379:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518322944:12345-0@lo:400:kworker.0 Request processed in 1165us (8917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572016.773391:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788572016.773576:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518322944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572017.256550:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572017.256631:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572017.256841:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518323456 00000100:00100000:2.0:1788572017.256852:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518323456 00000100:00100000:2.0:1788572017.256918:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788572017.256929:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518323456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572017.256971:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572017.257386:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518323456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 459us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572017.257418:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788572017.257934:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45196680 x1875453518323456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572017.257958:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518323456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572017.384631:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572017.769195:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518323584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572017.769299:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572017.769335:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518323584 00000100:00100000:0.0:1788572017.769344:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518323584 00000100:00100000:0.0:1788572017.769425:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788572017.769436:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518323584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572017.769738:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572017.769803:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518323584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 368us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572017.769827:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788572017.769914:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0765d2d80 x1875453518323584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572017.769938:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518323584:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788572018.102776:0:9241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.4 00010000:00010000:3.0:1788572018.413585:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572018.516746:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572018.516896:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572018.516962:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495222272 00000100:00100000:3.0:1788572018.516973:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495222272 00000100:00100000:3.0:1788572018.517033:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:3.0:1788572018.517043:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495222272:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572018.517114:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495222272:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 72us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572018.517121:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:0.0:1788572018.518002:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495222400 00000100:00100000:0.0:1788572018.518012:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495222400 00000100:00100000:0.0:1788572018.518153:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1788572018.518163:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495222400:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572018.518221:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495222400:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 60us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572018.518228:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00080000:3.0:1788572018.518302:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788572019.443066:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572020.471474:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572020.874816:0:9339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.4 00010000:00010000:3.0:1788572021.480899:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572021.873812:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518324096:0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.873885:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572021.873945:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572021.873951:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518323968:0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.873977:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572021.874011:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518324096 00000100:00100000:3.0:1788572021.874020:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518324096 00000100:00100000:3.0:1788572021.874078:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788572021.874087:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518324096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.874139:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518324096:12345-0@lo:400:kworker.0 Request processed in 52us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572021.874147:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788572021.874178:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788572021.874210:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050630700 x1875453518324096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572021.874224:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050630700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518324096:0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.874292:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518323840:0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.874332:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572021.874350:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518324352:0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.874370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572021.874389:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572021.874395:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518323712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.874422:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572021.874448:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518324224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.874469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572021.874493:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518324352 00000100:00100000:3.0:1788572021.874497:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518324352 00000100:00100000:0.0:1788572021.874729:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518323968 00000100:00100000:0.0:1788572021.874735:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518323968 00000100:00100000:0.0:1788572021.874761:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518323840 00000100:00100000:0.0:1788572021.874765:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518323840 00000100:00100000:0.0:1788572021.874778:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518324224 00000100:00100000:0.0:1788572021.874781:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518324224 00000100:00100000:0.0:1788572021.874795:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788572021.874802:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518323968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572021.874846:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518323968:12345-0@lo:400:kworker.0 Request processed in 44us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572021.874852:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788572021.874875:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788572021.874882:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518323840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572021.874917:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518323840:12345-0@lo:400:kworker.0 Request processed in 35us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572021.874923:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788572021.874934:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788572021.874940:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518324224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572021.874977:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518324224:12345-0@lo:400:kworker.0 Request processed in 37us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572021.874984:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788572021.875020:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518324224:0@lo:400:kworker.0 00000100:00100000:0.0:1788572021.875032:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518323840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572021.875057:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518323968:0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.875100:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788572021.875111:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518324352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.875158:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518324352:12345-0@lo:400:kworker.0 Request processed in 50us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572021.875164:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788572021.875186:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518323712 00000100:00100000:3.0:1788572021.875190:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518323712 00000100:00100000:3.0:1788572021.875215:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788572021.875221:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518323712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572021.875276:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518323712:12345-0@lo:400:kworker.0 Request processed in 55us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572021.875292:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1788572021.875753:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572021.875758:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572021.875911:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518323712:0@lo:400:kworker.0 00010000:00080000:0.0:1788572021.875927:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050630e00 x1875453518324352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572021.875937:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518324352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572022.378180:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572022.378205:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518324480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572022.378319:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572022.378661:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518324480 00000100:00100000:1.0:1788572022.378670:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518324480 00000100:00100000:1.0:1788572022.378739:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788572022.378750:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518324480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572022.378810:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572022.378871:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518324480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572022.378877:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788572022.378965:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45196680 x1875453518324480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572022.378984:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518324480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572022.505955:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572022.888767:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572022.888792:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572022.888860:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572022.889006:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518324608 00000100:00100000:1.0:1788572022.889014:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518324608 00000100:00100000:1.0:1788572022.889071:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572022.889081:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518324608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572022.889118:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572022.889211:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518324608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572022.889219:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788572022.900395:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45197800 x1875453518324608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572022.900423:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518324608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788572023.528688:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572023.642348:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572023.642406:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572023.642443:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495222528 00000100:00100000:2.0:1788572023.642454:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495222528 00000100:00100000:2.0:1788572023.642505:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:2.0:1788572023.642538:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2353:x1875453495222528:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572023.642609:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2353:x1875453495222528:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572023.642616:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:3.0:1788572023.644433:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495222656 00000100:00100000:3.0:1788572023.644444:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495222656 00000100:00100000:3.0:1788572023.644823:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:3.0:1788572023.644835:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495222656:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572023.644903:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495222656:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 72us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572023.644910:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00080000:3.0:1788572023.644940:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788572023.721944:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.4 00010000:00010000:3.0:1788572024.562887:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572025.343158:0:9485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 21:33:43 EDT 2026 00010000:00010000:3.0:1788572025.578644:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572026.600759:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572026.996454:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518324736:0@lo:400:kworker.0 00000100:00100000:2.0:1788572026.996665:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572026.996712:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518325248:0@lo:400:kworker.0 00000100:00100000:2.0:1788572026.996741:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572026.996768:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572026.996774:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518324864:0@lo:400:kworker.0 00000100:00100000:2.0:1788572026.996796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572026.996813:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518325376:0@lo:400:kworker.0 00000100:00100000:2.0:1788572026.996837:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572027.004569:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518325376 00000100:00100000:2.0:1788572027.004601:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518325376 00000100:00100000:2.0:1788572027.004685:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788572027.004696:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518325376:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788572027.004721:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572027.004792:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518325376:12345-0@lo:400:kworker.0 Request processed in 98us (7952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572027.004799:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788572027.004826:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518325248 00000100:00100000:2.0:1788572027.004830:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518325248 00000100:00100000:2.0:1788572027.004873:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518324864 00000100:00100000:2.0:1788572027.004877:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518324864 00000100:00100000:2.0:1788572027.004891:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788572027.004896:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518325248:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788572027.004899:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f7800 x1875453518325376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572027.004914:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518325376:0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.004927:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518325248:12345-0@lo:400:kworker.0 Request processed in 31us (8186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572027.004928:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518325248:0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.004933:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788572027.004943:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788572027.004948:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518324864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.004987:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518324864:12345-0@lo:400:kworker.0 Request processed in 39us (8190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572027.004993:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788572027.005016:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518324736 00000100:00100000:2.0:1788572027.005019:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518324736 00000100:00100000:2.0:1788572027.005042:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788572027.005047:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518324736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.005074:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518324736:12345-0@lo:400:kworker.0 Request processed in 28us (8411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572027.005079:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788572027.005118:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518325120:0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.005149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572027.005174:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572027.005179:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518324992:0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.005198:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572027.005263:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518325120 00000100:00100000:0.0:1788572027.005726:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518324864:0@lo:400:kworker.0 00000100:00100000:0.0:1788572027.005738:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518324736:0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.009741:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518325120 00000100:00080000:2.0:1788572027.009763:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572027.009783:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518324992 00000100:00100000:2.0:1788572027.009786:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518324992 00000100:00100000:2.0:1788572027.009854:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788572027.009863:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518324992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.009949:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518324992:12345-0@lo:400:kworker.0 Request processed in 87us (4748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572027.009955:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788572027.010578:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572027.010903:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518324992:0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.010973:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572027.010980:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518325120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572027.011032:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518325120:12345-0@lo:400:kworker.0 Request processed in 52us (5882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572027.011039:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788572027.011055:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788572027.011074:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f6300 x1875453518325120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572027.011086:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518325120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572027.497164:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572027.497187:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518325504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572027.497308:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572027.497467:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518325504 00000100:00100000:2.0:1788572027.497484:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518325504 00000100:00100000:2.0:1788572027.497539:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788572027.497548:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518325504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572027.497584:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572027.497630:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518325504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572027.497637:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788572027.497769:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f6300 x1875453518325504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572027.497789:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518325504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572027.625169:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572028.010160:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518325632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572028.010270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572028.011862:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518325632 00000100:00100000:3.0:1788572028.011875:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518325632 00000100:00100000:3.0:1788572028.011936:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788572028.011946:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518325632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572028.012607:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572028.012685:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518325632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 739us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572028.012693:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788572028.012744:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c555500 x1875453518325632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572028.012763:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518325632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572028.654403:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572028.758416:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572028.758474:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572028.758715:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495222784 00000100:00100000:1.0:1788572028.758726:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495222784 00000100:00100000:1.0:1788572028.758777:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:1.0:1788572028.758789:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495222784:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572028.758873:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495222784:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 73us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572028.758894:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:2.0:1788572028.759852:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495222912 00000100:00100000:2.0:1788572028.759929:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495222912 00000100:00100000:1.0:1788572028.760094:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1788572028.760107:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495222912:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572028.760169:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495222912:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 65us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572028.760176:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00080000:3.0:1788572028.761065:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572029.674539:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572030.699516:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572031.720779:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572032.104600:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518326016:0@lo:400:kworker.0 00000100:00100000:2.0:1788572032.104730:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572032.104789:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572032.104796:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518326144:0@lo:400:kworker.0 00000100:00100000:2.0:1788572032.104823:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572032.104858:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518326016 00000100:00100000:2.0:1788572032.104865:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518326016 00000100:00100000:2.0:1788572032.104915:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788572032.104925:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518326016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572032.104974:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518326016:12345-0@lo:400:kworker.0 Request processed in 52us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572032.104981:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788572032.105005:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518326144 00000100:00100000:2.0:1788572032.105008:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518326144 00000100:00100000:2.0:1788572032.105033:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788572032.105038:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518326144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572032.105066:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518326144:12345-0@lo:400:kworker.0 Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572032.105089:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788572032.105106:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572032.105110:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788572032.105150:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f7480 x1875453518326144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572032.105162:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518326144:0@lo:400:kworker.0 00000100:00100000:2.0:1788572032.105174:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518326016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105285:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518325760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105319:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572032.105345:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518326272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105365:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572032.105383:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788572032.105388:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518325888:0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105407:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572032.105422:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518326400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105441:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572032.105464:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518326272 00000100:00100000:1.0:1788572032.105467:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518326272 00000100:00100000:1.0:1788572032.105493:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518325888 00000100:00100000:1.0:1788572032.105496:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518325888 00000100:00100000:1.0:1788572032.105509:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788572032.105514:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518326272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105545:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518326272:12345-0@lo:400:kworker.0 Request processed in 31us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572032.105551:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788572032.105572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788572032.105578:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518325888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105605:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518325888:12345-0@lo:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572032.105610:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788572032.105627:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518325760 00000100:00100000:1.0:1788572032.105630:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518325760 00000100:00100000:1.0:1788572032.105653:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788572032.105659:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518325760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105685:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518325760:12345-0@lo:400:kworker.0 Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572032.105690:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788572032.105714:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518326400 00000100:00100000:1.0:1788572032.105718:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518326400 00000100:00100000:1.0:1788572032.105741:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788572032.105748:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518326400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105775:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518326400:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572032.105781:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788572032.105796:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572032.105799:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572032.105820:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518325888:0@lo:400:kworker.0 00010000:00080000:1.0:1788572032.105831:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f6680 x1875453518326400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572032.105841:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518326400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105848:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518325760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.105865:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518326272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572032.617382:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572032.617405:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518326528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572032.617498:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572032.617560:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518326528 00000100:00100000:1.0:1788572032.617569:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518326528 00000100:00100000:1.0:1788572032.617625:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788572032.617635:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518326528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572032.617672:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572032.617714:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518326528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572032.617720:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788572032.617762:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07676e300 x1875453518326528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572032.617780:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518326528:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572032.744628:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572033.132490:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518326656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572033.132570:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572033.132841:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518326656 00000100:00100000:0.0:1788572033.132852:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518326656 00000100:00100000:0.0:1788572033.132928:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788572033.132940:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518326656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572033.132977:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572033.150041:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518326656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17092us (17457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572033.150056:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788572033.151650:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0765d0000 x1875453518326656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572033.151685:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518326656:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572033.771075:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572033.884119:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572033.884162:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572033.895231:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495223040 00000100:00100000:3.0:1788572033.895261:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495223040 00000100:00100000:3.0:1788572033.895337:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:3.0:1788572033.895349:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2356:x1875453495223040:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572033.895430:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2356:x1875453495223040:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 83us (11330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572033.895453:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:2.0:1788572033.896869:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495223168 00000100:00100000:2.0:1788572033.896880:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495223168 00000100:00100000:2.0:1788572033.896932:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1788572033.896941:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495223168:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572033.896990:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495223168:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 50us (12826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572033.896997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00080000:1.0:1788572033.897241:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572034.795865:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572035.832754:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572036.840595:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572037.225223:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518326784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572037.225230:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518327040:0@lo:400:kworker.0 00000100:00100000:3.0:1788572037.225524:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518326912:0@lo:400:kworker.0 00000100:00100000:2.0:1788572037.226186:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572037.226330:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518327296:0@lo:400:kworker.0 00000100:00100000:2.0:1788572037.226376:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572037.227624:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572037.227797:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518327424:0@lo:400:kworker.0 00000100:00100000:3.0:1788572037.227828:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572037.227873:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518327168:0@lo:400:kworker.0 00000100:00100000:3.0:1788572037.227899:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572037.227931:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518327424 00000100:00100000:3.0:1788572037.227938:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518327424 00000100:00100000:3.0:1788572037.227991:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518327168 00000100:00100000:3.0:1788572037.227994:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518327168 00000100:00100000:3.0:1788572037.228012:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788572037.228029:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518327424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572037.228094:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518327424:12345-0@lo:400:kworker.0 Request processed in 75us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572037.228100:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788572037.228117:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788572037.228123:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518327168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572037.228153:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518327168:12345-0@lo:400:kworker.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572037.228158:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788572037.228176:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572037.228179:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788572037.228774:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07676c700 x1875453518327168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572037.228813:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518327168:0@lo:400:kworker.0 00010000:00080000:3.0:1788572037.228853:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07676c000 x1875453518327424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572037.228863:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518327424:0@lo:400:kworker.0 00000100:00100000:1.0:1788572037.232779:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518326784 00000100:00100000:1.0:1788572037.232795:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518326784 00000100:00100000:1.0:1788572037.232861:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788572037.232872:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518326784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572037.232987:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518326784:12345-0@lo:400:kworker.0 Request processed in 117us (6803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572037.232995:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788572037.233090:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572037.244444:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518326784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572037.249338:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518327296 00000100:00100000:0.0:1788572037.249359:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518327296 00000100:00100000:0.0:1788572037.249435:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518326912 00000100:00100000:0.0:1788572037.249439:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518326912 00000100:00100000:0.0:1788572037.249464:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518327040 00000100:00100000:0.0:1788572037.249467:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518327040 00000100:00100000:0.0:1788572037.249489:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572037.249499:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518327296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572037.249587:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518327296:12345-0@lo:400:kworker.0 Request processed in 89us (23209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572037.249595:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572037.249614:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788572037.249620:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518326912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572037.249678:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518326912:12345-0@lo:400:kworker.0 Request processed in 58us (22060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572037.249697:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788572037.249710:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788572037.249715:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518327040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572037.249749:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518327040:12345-0@lo:400:kworker.0 Request processed in 34us (16659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572037.249755:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788572037.252612:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572037.252680:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518327040:0@lo:400:kworker.0 00000100:00100000:1.0:1788572037.252729:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518327296:0@lo:400:kworker.0 00000100:00100000:3.0:1788572037.258006:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518326912:0@lo:400:kworker.0 00000100:00100000:3.0:1788572037.736481:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572037.736506:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518327552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572037.736575:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572037.736792:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518327552 00000100:00100000:1.0:1788572037.736801:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518327552 00000100:00100000:1.0:1788572037.736853:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788572037.736863:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518327552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572037.736898:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572037.736942:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518327552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572037.736949:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788572037.736987:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07676f100 x1875453518327552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572037.737016:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518327552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572037.864434:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572038.248571:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518327680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572038.248645:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572038.248769:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518327680 00000100:00100000:1.0:1788572038.248777:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518327680 00000100:00100000:1.0:1788572038.248831:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788572038.248841:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518327680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572038.248875:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572038.248920:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518327680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572038.248927:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788572038.249023:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07676f100 x1875453518327680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572038.249108:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518327680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572038.890695:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572038.998180:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572038.998223:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572038.998615:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495223424 00000100:00100000:2.0:1788572038.998630:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495223424 00000100:00100000:2.0:1788572038.998735:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:2.0:1788572038.998748:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495223424:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572038.998837:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495223424:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 92us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572038.998844:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:0.0:1788572038.999033:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495223296 00000100:00100000:0.0:1788572038.999040:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495223296 00000100:00100000:0.0:1788572038.999073:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:0.0:1788572038.999081:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495223296:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572038.999114:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495223296:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 35us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572038.999120:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00080000:1.0:1788572038.999296:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788572039.913993:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572040.936461:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572041.634166:0:10116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:33:59 (1788572039) === 00010000:00010000:1.0:1788572041.964155:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572042.045127:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572042.056005:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495223552 00000100:00100000:3.0:1788572042.056022:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495223552 00000100:00100000:3.0:1788572042.056089:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:3.0:1788572042.056100:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+10:8156:x1875453495223552:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788572042.056116:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572042.056134:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387800/0x977d9e7969bff64e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10d95 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572042.056165:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387800/0x977d9e7969bff64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d95 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572042.056197:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387800/0x977d9e7969bff64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d95 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572042.056206:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387800, rc 0) 00000100:00100000:3.0:1788572042.056297:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8156:x1875453495223552:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 199us (11182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572042.056304:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:1.0:1788572042.067358:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572042.067444:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495223680 00000100:00100000:3.0:1788572042.067455:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495223680 00000100:00100000:3.0:1788572042.067512:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:3.0:1788572042.067522:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8156:x1875453495223680:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788572042.067866:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8156:x1875453495223680:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 344us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572042.067874:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:2.0:1788572042.078705:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572042.078857:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495223808 00000100:00100000:0.0:1788572042.078868:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495223808 00000100:00100000:0.0:1788572042.078927:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:0.0:1788572042.078936:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8156:x1875453495223808:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788572042.079156:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8156:x1875453495223808:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 220us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.079164:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:2.0:1788572042.092574:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572042.092779:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495223936 00000100:00100000:1.0:1788572042.092789:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495223936 00000100:00100000:1.0:1788572042.092859:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:1.0:1788572042.092869:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8160:x1875453495223936:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788572042.093162:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8160:x1875453495223936:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 294us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572042.093170:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:1.0:1788572042.117385:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572042.117633:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495224064 00000100:00100000:3.0:1788572042.117644:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495224064 00000100:00100000:3.0:1788572042.117696:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:3.0:1788572042.117707:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8160:x1875453495224064:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788572042.118029:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8160:x1875453495224064:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 322us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572042.118037:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:2.0:1788572042.131785:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572042.131902:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495224192 00000100:00100000:0.0:1788572042.131912:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495224192 00000100:00100000:0.0:1788572042.131976:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:0.0:1788572042.131987:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+11:8156:x1875453495224192:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788572042.132021:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572042.132043:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10dbf expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572042.132071:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dbf expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572042.132084:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dbf expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572042.132094:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90a00, rc 0) 00000100:00100000:0.0:1788572042.132157:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+12:8156:x1875453495224192:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 172us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.132164:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:2.0:1788572042.137303:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572042.137732:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495224320 00000100:00100000:3.0:1788572042.137742:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495224320 00000100:00100000:3.0:1788572042.137797:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:3.0:1788572042.137807:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+12:8156:x1875453495224320:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788572042.137872:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788572042.137889:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788572042.137893:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788572042.137896:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788572042.137899:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788572042.139920:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+12:8156:x1875453495224320:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 2103us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572042.139935:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:2.0:1788572042.146941:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572042.147068:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495224448 00000100:00100000:1.0:1788572042.147079:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495224448 00000100:00100000:1.0:1788572042.147139:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:1.0:1788572042.147150:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:8156:x1875453495224448:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788572042.147167:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572042.147184:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10dc6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572042.147213:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dc6 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572042.147224:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dc6 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572042.147284:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2800, rc 0) 00000100:00100000:1.0:1788572042.147400:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:8156:x1875453495224448:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 196us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572042.147408:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:2.0:1788572042.156191:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572042.156287:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495224576 00000100:00100000:0.0:1788572042.156297:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495224576 00000100:00100000:0.0:1788572042.156360:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:0.0:1788572042.156369:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:8156:x1875453495224576:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788572042.156666:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:8156:x1875453495224576:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 297us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.156675:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:2.0:1788572042.158901:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572042.158951:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495224704 00000100:00100000:3.0:1788572042.158962:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495224704 00000100:00100000:3.0:1788572042.159016:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:3.0:1788572042.159025:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:8156:x1875453495224704:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788572042.159297:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:8156:x1875453495224704:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 272us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572042.159305:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:2.0:1788572042.164356:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572042.164624:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495224832 00000100:00100000:1.0:1788572042.164635:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495224832 00000100:00100000:1.0:1788572042.164694:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 219 00000100:00100000:1.0:1788572042.164703:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:8164:x1875453495224832:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788572042.164957:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:8164:x1875453495224832:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 254us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572042.164966:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 219 00000100:00100000:2.0:1788572042.167664:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572042.167785:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495224960 00000100:00100000:0.0:1788572042.167797:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495224960 00000100:00100000:0.0:1788572042.167885:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:0.0:1788572042.167896:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:8164:x1875453495224960:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788572042.168187:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:8164:x1875453495224960:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 292us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.168202:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:2.0:1788572042.180531:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572042.181495:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495225216 00000100:00100000:3.0:1788572042.181507:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495225216 00000100:00100000:3.0:1788572042.181594:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:3.0:1788572042.181606:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495225216:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572042.181693:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495225216:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 90us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572042.181701:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00080000:1.0:1788572042.181946:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572042.188799:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572042.188976:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495225088 00000100:00100000:3.0:1788572042.188987:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495225088 00000100:00100000:3.0:1788572042.189042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1788572042.189059:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1875453495225088:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788572042.189102:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a29edff0-34e1-4cac-beac-cd8589fdf9ee@192.168.202.2@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1788572042.189151:0:5832:0:(genops.c:1385:class_connect()) connect: client a29edff0-34e1-4cac-beac-cd8589fdf9ee, cookie 0x977d9e7969bff663 00000004:00100000:3.0:1788572042.189181:0:5832:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788572042.189689:0:5832:0:(import.c:65:import_set_state_nolock()) ffff88c0484ad000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572042.189762:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2352:x1875453495225088:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 709us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572042.189770:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788572042.194638:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572042.194735:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495225472 00000100:00100000:2.0:1788572042.194744:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495225472 00000100:00100000:2.0:1788572042.194866:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788572042.194876:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:8156:x1875453495225472:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788572042.194915:0:5830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788572042.194996:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:8156:x1875453495225472:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 122us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572042.195003:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00080000:1.0:1788572042.195668:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572042.203719:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572042.203854:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495225344 00000100:00100000:0.0:1788572042.203873:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495225344 00000100:00100000:0.0:1788572042.203930:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1788572042.203940:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:0:x1875453495225344:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788572042.203974:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788572042.204204:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:0:x1875453495225344:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 265us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.204212:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1788572042.205245:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572042.205337:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495225600 00000100:00100000:3.0:1788572042.205352:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495225600 00000100:00100000:3.0:1788572042.205391:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1788572042.205400:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:8156:x1875453495225600:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788572042.205466:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:8156:x1875453495225600:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 67us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572042.205472:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572042.209356:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572042.209868:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572042.209903:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572042.209980:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495225728 00000100:00100000:1.0:1788572042.209994:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495225728 00000100:00100000:1.0:1788572042.210039:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495225856 00000100:00100000:1.0:1788572042.210043:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495225856 00000100:00100000:1.0:1788572042.210071:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1788572042.210080:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875453495225728:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788572042.210113:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a29edff0-34e1-4cac-beac-cd8589fdf9ee@192.168.202.2@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1788572042.210143:0:6679:0:(genops.c:1385:class_connect()) connect: client a29edff0-34e1-4cac-beac-cd8589fdf9ee, cookie 0x977d9e7969bff66a 00002000:00100000:1.0:1788572042.210154:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a29edff0-34e1-4cac-beac-cd8589fdf9ee/ffff88bf4530c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572042.210179:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788572042.210448:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788572042.210477:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88bf45308000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572042.210542:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2352:x1875453495225728:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 461us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572042.210549:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1788572042.210566:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572042.210571:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875453495225856:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788572042.210586:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a29edff0-34e1-4cac-beac-cd8589fdf9ee@192.168.202.2@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:1.0:1788572042.210603:0:6679:0:(genops.c:1385:class_connect()) connect: client a29edff0-34e1-4cac-beac-cd8589fdf9ee, cookie 0x977d9e7969bff671 00002000:00100000:1.0:1788572042.210609:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a29edff0-34e1-4cac-beac-cd8589fdf9ee/ffff88bf4531c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572042.210622:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788572042.210739:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788572042.210753:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88bf45319000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572042.210776:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2352:x1875453495225856:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 203us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572042.210783:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1788572042.211076:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495225984 00000100:00100000:0.0:1788572042.211082:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495225984 00000100:00100000:0.0:1788572042.211125:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:0.0:1788572042.211133:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:8156:x1875453495225984:12345-192.168.202.2@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788572042.211192:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788572042.211234:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:8156:x1875453495225984:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 103us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.211241:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:3.0:1788572042.345548:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518328192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572042.345617:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572042.345682:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572042.345688:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518328064:0@lo:400:kworker.0 00000100:00100000:3.0:1788572042.345711:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572042.345747:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518328064 00000100:00100000:3.0:1788572042.345755:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518328064 00000100:00100000:3.0:1788572042.345807:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788572042.345847:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518328064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572042.345902:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518328064:12345-0@lo:400:kworker.0 Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572042.345918:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788572042.345961:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518328064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.346106:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518327936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.346136:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572042.346162:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518328448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.346183:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572042.346207:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788572042.346212:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518327808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.346297:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572042.346323:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518328320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.346344:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572042.346370:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518328192 00000100:00100000:0.0:1788572042.346375:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518328192 00000100:00100000:0.0:1788572042.346405:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518328448 00000100:00100000:0.0:1788572042.346408:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518328448 00000100:00100000:0.0:1788572042.346425:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788572042.346432:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518328192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.346468:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518328192:12345-0@lo:400:kworker.0 Request processed in 38us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.346474:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788572042.346489:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788572042.346494:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518328448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.346522:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518328448:12345-0@lo:400:kworker.0 Request processed in 29us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.346693:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788572042.346891:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764bb100 x1875453518328448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572042.346903:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518328448:0@lo:400:kworker.0 00010000:00080000:0.0:1788572042.346929:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764bbb80 x1875453518328192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572042.346939:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518328192:0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.346955:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518327936 00000100:00100000:0.0:1788572042.346959:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518327936 00000100:00100000:0.0:1788572042.346994:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518328320 00000100:00100000:0.0:1788572042.346997:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518328320 00000100:00100000:0.0:1788572042.347010:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788572042.347015:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518327936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.347054:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518327936:12345-0@lo:400:kworker.0 Request processed in 38us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.347060:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788572042.347072:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788572042.347078:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518328320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.347104:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518328320:12345-0@lo:400:kworker.0 Request processed in 26us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.347110:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788572042.347133:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518328320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.347143:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518327936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572042.347164:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518327808 00000100:00100000:0.0:1788572042.347168:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518327808 00000100:00100000:0.0:1788572042.347192:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788572042.347198:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518327808:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788572042.347546:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572042.347551:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572042.347554:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572042.347916:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518327808:12345-0@lo:400:kworker.0 Request processed in 715us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572042.347924:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788572042.348059:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518327808:0@lo:400:kworker.0 00000100:00100000:2.0:1788572042.856943:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518328576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572042.857011:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572042.857377:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518328576 00000100:00100000:1.0:1788572042.857385:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518328576 00000100:00100000:1.0:1788572042.857438:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788572042.857448:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518328576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572042.857471:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572042.857520:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518328576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572042.857539:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788572042.857719:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07676d180 x1875453518328576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572042.857738:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518328576:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572042.985801:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572043.369638:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572043.369664:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518328704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572043.369727:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572043.369833:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518328704 00000100:00100000:1.0:1788572043.369841:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518328704 00000100:00100000:1.0:1788572043.369883:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788572043.369892:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518328704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572043.369925:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572043.369970:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518328704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572043.369977:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788572043.370880:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07676d180 x1875453518328704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572043.370900:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518328704:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788572043.474428:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a29edff0-34e1-4cac-beac-cd8589fdf9ee 00000001:00100000:3.0:1788572043.485828:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a29edff0-34e1-4cac-beac-cd8589fdf9ee 00000001:00100000:1.0:1788572043.986517:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a29edff0-34e1-4cac-beac-cd8589fdf9ee 00010000:00010000:1.0:1788572044.010610:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572045.035637:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572046.056438:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572047.080479:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572047.465919:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518329216:0@lo:400:kworker.0 00000100:00100000:2.0:1788572047.465984:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572047.466046:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572047.466052:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518329088:0@lo:400:kworker.0 00000100:00100000:2.0:1788572047.466074:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572047.466109:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518329216 00000100:00100000:2.0:1788572047.466115:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518329216 00000100:00100000:2.0:1788572047.466177:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572047.466185:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518329216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572047.466229:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518329216:12345-0@lo:400:kworker.0 Request processed in 45us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572047.466242:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572047.466283:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518329088 00000100:00100000:2.0:1788572047.466287:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518329088 00000100:00100000:2.0:1788572047.466312:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788572047.466318:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518329088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572047.466345:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518329088:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572047.466351:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788572047.466365:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572047.466369:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572047.466399:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518329088:0@lo:400:kworker.0 00010000:00080000:2.0:1788572047.466411:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f1f80 x1875453518329216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572047.466421:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518329216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572047.466592:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518328832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572047.466637:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572047.466668:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518329344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572047.466687:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572047.466703:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788572047.466707:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518328960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572047.466724:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572047.466735:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518329472:0@lo:400:kworker.0 00000100:00100000:1.0:1788572047.466751:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572047.466772:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518329472 00000100:00100000:1.0:1788572047.466776:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518329472 00000100:00100000:1.0:1788572047.466798:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788572047.466810:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518329472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572047.466855:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518329472:12345-0@lo:400:kworker.0 Request processed in 45us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572047.466861:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788572047.466883:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f1880 x1875453518329472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572047.466893:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518329472:0@lo:400:kworker.0 00000100:00100000:3.0:1788572047.466997:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518329344 00000100:00100000:3.0:1788572047.467001:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518329344 00000100:00100000:3.0:1788572047.467031:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518328960 00000100:00100000:3.0:1788572047.467033:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518328960 00000100:00100000:3.0:1788572047.467045:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788572047.467051:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518329344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572047.467086:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518329344:12345-0@lo:400:kworker.0 Request processed in 35us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572047.467092:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788572047.467102:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788572047.467107:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518328960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572047.467128:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518328960:12345-0@lo:400:kworker.0 Request processed in 21us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572047.467134:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788572047.467153:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518328960:0@lo:400:kworker.0 00000100:00100000:3.0:1788572047.467161:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518329344:0@lo:400:kworker.0 00000100:00100000:2.0:1788572047.468562:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518328832 00000100:00100000:2.0:1788572047.468572:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518328832 00000100:00100000:2.0:1788572047.468626:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788572047.468635:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518328832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572047.468696:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518328832:12345-0@lo:400:kworker.0 Request processed in 63us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572047.468702:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:2.0:1788572047.468730:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572047.468734:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572047.468853:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518328832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572047.726283:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572047.726317:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572047.726454:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495226112 00000100:00100000:0.0:1788572047.726463:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495226112 00000100:00100000:0.0:1788572047.726516:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 223 00000100:00100000:0.0:1788572047.726524:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2354:x1875453495226112:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572047.726591:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2354:x1875453495226112:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 67us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572047.726620:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 223 00000100:00100000:3.0:1788572047.729531:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495226240 00000100:00100000:3.0:1788572047.729542:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495226240 00000100:00100000:3.0:1788572047.729610:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:3.0:1788572047.729619:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495226240:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572047.729705:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495226240:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 87us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572047.729713:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00080000:2.0:1788572047.729864:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572047.729908:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572047.730002:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572047.730034:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572047.730092:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495226496 00000100:00100000:1.0:1788572047.730096:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495226496 00000100:00100000:1.0:1788572047.730133:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495226624 00000100:00100000:1.0:1788572047.730136:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495226624 00000100:00100000:1.0:1788572047.730151:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:1.0:1788572047.730157:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495226496:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572047.730188:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495226496:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 30us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572047.730193:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:1.0:1788572047.730204:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:1.0:1788572047.730210:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495226624:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572047.730228:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495226624:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 18us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572047.730234:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00080000:2.0:1788572047.730723:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572047.730726:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572047.733942:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495226368 00000100:00100000:3.0:1788572047.733954:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495226368 00000100:00100000:3.0:1788572047.734028:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:3.0:1788572047.734037:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495226368:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572047.734093:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495226368:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 58us (4185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572047.734101:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00080000:2.0:1788572047.734218:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572047.976777:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518329600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572047.976867:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572047.977007:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518329600 00000100:00100000:3.0:1788572047.977015:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518329600 00000100:00100000:3.0:1788572047.977066:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788572047.977076:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518329600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572047.977110:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572047.977163:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518329600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572047.977170:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788572047.977285:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764bb800 x1875453518329600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572047.977304:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518329600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572048.104482:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572048.488537:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572048.488559:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518329728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572048.488648:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572048.488996:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518329728 00000100:00100000:3.0:1788572048.489004:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518329728 00000100:00100000:3.0:1788572048.489059:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788572048.489069:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518329728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572048.489099:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572048.489166:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518329728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572048.489173:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788572048.489302:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07676ca80 x1875453518329728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572048.489319:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518329728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572049.128894:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572049.577341:0:10313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788572050.152634:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572051.176526:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572052.210364:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572052.585822:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518330112:0@lo:400:kworker.0 00000100:00100000:2.0:1788572052.585900:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572052.585967:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572052.585974:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518330240:0@lo:400:kworker.0 00000100:00100000:2.0:1788572052.585999:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572052.586033:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518330112 00000100:00100000:2.0:1788572052.586040:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518330112 00000100:00100000:2.0:1788572052.586095:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788572052.586106:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518330112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572052.586158:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518330112:12345-0@lo:400:kworker.0 Request processed in 54us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572052.586166:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788572052.586190:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518330240 00000100:00100000:2.0:1788572052.586193:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518330240 00000100:00100000:2.0:1788572052.586220:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572052.586226:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518330240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572052.586280:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518330240:12345-0@lo:400:kworker.0 Request processed in 54us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572052.586299:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788572052.586316:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572052.586321:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788572052.586352:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f0700 x1875453518330240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572052.586366:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518330240:0@lo:400:kworker.0 00000100:00100000:2.0:1788572052.586378:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518330112:0@lo:400:kworker.0 00000100:00100000:1.0:1788572052.586482:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518329984:0@lo:400:kworker.0 00000100:00100000:1.0:1788572052.586512:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572052.586538:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518330496:0@lo:400:kworker.0 00000100:00100000:1.0:1788572052.586558:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572052.586576:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788572052.586582:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518329856:0@lo:400:kworker.0 00000100:00100000:1.0:1788572052.586607:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572052.586628:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518330368:0@lo:400:kworker.0 00000100:00100000:1.0:1788572052.586650:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572052.586673:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518330496 00000100:00100000:1.0:1788572052.586677:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518330496 00000100:00100000:1.0:1788572052.586702:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788572052.586709:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518330496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572052.586743:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518330496:12345-0@lo:400:kworker.0 Request processed in 36us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572052.586750:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788572052.586769:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518329856 00000100:00100000:1.0:1788572052.586773:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518329856 00000100:00100000:1.0:1788572052.586795:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788572052.586801:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518329856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572052.586829:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518329856:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572052.586842:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788572052.586875:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518329856:0@lo:400:kworker.0 00010000:00080000:1.0:1788572052.586886:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07f7f0000 x1875453518330496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572052.586895:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518330496:0@lo:400:kworker.0 00000100:00100000:2.0:1788572052.587019:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518329984 00000100:00100000:2.0:1788572052.587023:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518329984 00000100:00100000:2.0:1788572052.587089:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518330368 00000100:00100000:2.0:1788572052.587092:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518330368 00000100:00100000:3.0:1788572052.588480:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788572052.588512:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518329984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572052.588609:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518329984:12345-0@lo:400:kworker.0 Request processed in 106us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572052.588617:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788572052.588940:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788572052.589024:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518330368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572052.589062:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518330368:12345-0@lo:400:kworker.0 Request processed in 115us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572052.589069:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788572052.589159:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518330368:0@lo:400:kworker.0 00000100:00100000:1.0:1788572052.589171:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518329984:0@lo:400:kworker.0 00000100:00080000:3.0:1788572052.595806:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572052.595818:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572052.842831:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572052.842989:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572052.843197:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572052.843341:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495227136 00000100:00100000:2.0:1788572052.843350:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495226752 00000100:00100000:3.0:1788572052.843351:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495227136 00000100:00100000:2.0:1788572052.843354:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495226752 00000100:00100000:1.0:1788572052.843364:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572052.843412:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 225 00000100:00100000:3.0:1788572052.843413:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:3.0:1788572052.843421:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2355:x1875453495227136:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572052.843422:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495226752:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572052.843487:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2355:x1875453495227136:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 67us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572052.843495:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00080000:3.0:1788572052.843530:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572052.844533:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495226752:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 1108us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572052.844547:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 225 00000100:00100000:1.0:1788572052.845593:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572052.845594:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495226880 00000100:00100000:0.0:1788572052.845604:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495226880 00000100:00100000:0.0:1788572052.845665:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495227008 00000100:00100000:0.0:1788572052.845669:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495227008 00000100:00100000:0.0:1788572052.845687:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:0.0:1788572052.845696:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495226880:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572052.845924:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788572052.845931:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788572052.845935:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788572052.845947:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:2.0:1788572052.845957:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495227008:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572052.846084:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495227264 00000100:00100000:3.0:1788572052.846089:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495227264 00000100:00100000:3.0:1788572052.846187:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:3.0:1788572052.846196:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495227264:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572052.846275:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495226880:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 579us (3454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572052.846283:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:2.0:1788572052.846867:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495227008:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 909us (3501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572052.846875:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00080000:2.0:1788572052.846905:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572052.846917:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572052.846967:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495227264:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 771us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572052.846976:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1788572053.096496:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518330624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572053.096577:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572053.096697:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518330624 00000100:00100000:3.0:1788572053.096706:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518330624 00000100:00100000:3.0:1788572053.096760:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788572053.096777:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518330624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572053.096813:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572053.096947:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518330624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572053.096954:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788572053.096993:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764b9180 x1875453518330624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572053.097012:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518330624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572053.224460:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572053.610384:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518330752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572053.610459:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572053.610523:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518330752 00000100:00100000:3.0:1788572053.610529:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518330752 00000100:00100000:3.0:1788572053.610564:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788572053.610571:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518330752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572053.610602:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572053.610643:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518330752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572053.610650:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788572053.610690:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764b9180 x1875453518330752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572053.610706:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518330752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572054.248683:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572055.280441:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572056.297747:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572057.329445:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572057.704533:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518331008:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.704608:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572057.704661:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518331520:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.704687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572057.704727:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788572057.704734:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518330880:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.704765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572057.704784:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518331392:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.704802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572057.704824:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518331136:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.704846:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572057.704864:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572057.704869:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518331264:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.704888:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572057.704920:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518331008 00000100:00100000:0.0:1788572057.704928:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518331008 00000100:00100000:0.0:1788572057.704973:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518331392 00000100:00100000:0.0:1788572057.704977:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518331392 00000100:00100000:0.0:1788572057.705001:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518331136 00000100:00100000:0.0:1788572057.705004:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518331136 00000100:00100000:0.0:1788572057.705020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788572057.705028:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518331008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705080:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518331008:12345-0@lo:400:kworker.0 Request processed in 52us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572057.705087:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788572057.705106:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788572057.705112:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518331392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705155:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518331392:12345-0@lo:400:kworker.0 Request processed in 43us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572057.705161:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788572057.705173:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788572057.705186:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518331136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705231:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518331136:12345-0@lo:400:kworker.0 Request processed in 46us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572057.705237:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788572057.705287:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518331520 00000100:00100000:0.0:1788572057.705291:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518331520 00000100:00100000:0.0:1788572057.705317:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518331264 00000100:00100000:0.0:1788572057.705320:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518331264 00000100:00100000:0.0:1788572057.705335:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572057.705341:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518331520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705372:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518331520:12345-0@lo:400:kworker.0 Request processed in 32us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572057.705378:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572057.705389:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788572057.705395:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518331264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705421:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518331264:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572057.705427:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788572057.705444:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518330880 00000100:00100000:0.0:1788572057.705448:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518330880 00000100:00100000:0.0:1788572057.705474:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788572057.705481:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518330880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705511:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518330880:12345-0@lo:400:kworker.0 Request processed in 31us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572057.705517:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1788572057.705550:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572057.705554:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572057.705563:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788572057.705596:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0765d1500 x1875453518331264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572057.705609:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518331264:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705621:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518331136:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705650:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518330880:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705659:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518331392:0@lo:400:kworker.0 00000100:00100000:0.0:1788572057.705670:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518331008:0@lo:400:kworker.0 00010000:00080000:0.0:1788572057.705679:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0765d3b80 x1875453518331520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572057.705688:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518331520:0@lo:400:kworker.0 00000100:00100000:3.0:1788572057.946275:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572057.946311:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572057.946338:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572057.946358:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572057.946401:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572057.946448:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495227648 00000100:00100000:3.0:1788572057.946457:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495227648 00000100:00100000:3.0:1788572057.946719:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495227520 00000100:00100000:3.0:1788572057.946723:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495227520 00000100:00100000:3.0:1788572057.946759:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:3.0:1788572057.946769:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495227648:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572057.946839:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495227648:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 71us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572057.946847:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:3.0:1788572057.946863:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:3.0:1788572057.946869:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495227520:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572057.946891:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495227520:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 22us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572057.946898:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:3.0:1788572057.946914:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495227904 00000100:00100000:3.0:1788572057.946918:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495227904 00000100:00100000:3.0:1788572057.946942:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495227776 00000100:00100000:3.0:1788572057.946945:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495227776 00000100:00100000:3.0:1788572057.946959:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:3.0:1788572057.946965:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495227904:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572057.946987:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495227904:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572057.946993:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:3.0:1788572057.947003:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:3.0:1788572057.947008:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495227776:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572057.947037:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495227776:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 29us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572057.947043:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00080000:3.0:1788572057.947062:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572057.947066:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572057.947068:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572057.949157:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495227392 00000100:00100000:2.0:1788572057.949173:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495227392 00000100:00100000:2.0:1788572057.949717:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 227 00000100:00100000:2.0:1788572057.949730:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495227392:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572057.949804:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495227392:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 77us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572057.949811:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 227 00000100:00100000:3.0:1788572058.216696:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518331648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572058.216772:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572058.216867:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518331648 00000100:00100000:3.0:1788572058.216874:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518331648 00000100:00100000:3.0:1788572058.216923:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788572058.216933:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518331648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572058.216967:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572058.217016:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518331648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572058.217023:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788572058.217068:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764ba680 x1875453518331648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572058.217087:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518331648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572058.346853:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572058.728447:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572058.728471:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518331776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572058.728540:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572058.728607:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518331776 00000100:00100000:1.0:1788572058.728614:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518331776 00000100:00100000:1.0:1788572058.728663:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788572058.728671:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518331776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572058.728705:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572058.728755:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518331776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572058.728762:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788572058.728801:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076234a80 x1875453518331776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572058.728818:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518331776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572059.369382:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572060.394926:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572061.425720:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572062.441451:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572062.824547:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518332288:0@lo:400:kworker.0 00000100:00100000:1.0:1788572062.824619:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572062.824688:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572062.824695:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518332160:0@lo:400:kworker.0 00000100:00100000:1.0:1788572062.824722:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572062.824772:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518332288 00000100:00100000:1.0:1788572062.824780:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518332288 00000100:00100000:1.0:1788572062.824835:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788572062.824847:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518332288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572062.824895:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518332288:12345-0@lo:400:kworker.0 Request processed in 52us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572062.824902:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788572062.824925:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518332160 00000100:00100000:1.0:1788572062.824928:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518332160 00000100:00100000:1.0:1788572062.824954:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788572062.824961:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518332160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572062.824989:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518332160:12345-0@lo:400:kworker.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572062.824994:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788572062.825036:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572062.825041:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572062.825074:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518332160:0@lo:400:kworker.0 00010000:00080000:1.0:1788572062.825086:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0502f3480 x1875453518332288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572062.825096:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518332288:0@lo:400:kworker.0 00000100:00100000:0.0:1788572062.825458:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518332032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572062.825491:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572062.825521:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518332544:0@lo:400:kworker.0 00000100:00100000:0.0:1788572062.825541:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572062.825559:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788572062.825565:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518331904:0@lo:400:kworker.0 00000100:00100000:0.0:1788572062.825590:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572062.825612:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518332416:0@lo:400:kworker.0 00000100:00100000:0.0:1788572062.825630:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572062.825653:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518332544 00000100:00100000:1.0:1788572062.825711:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518332032 00000100:00100000:1.0:1788572062.825716:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518332032 00000100:00100000:1.0:1788572062.825869:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518332416 00000100:00100000:1.0:1788572062.825873:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518332416 00000100:00100000:1.0:1788572062.825894:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788572062.825899:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518332032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572062.825938:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518332032:12345-0@lo:400:kworker.0 Request processed in 39us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572062.825944:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788572062.825957:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788572062.825963:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518332416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572062.825988:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518332416:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572062.825994:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788572062.826023:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572062.826073:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518332416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572062.826087:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518332032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572062.826200:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518332544 00000100:00100000:3.0:1788572062.828051:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518331904 00000100:00100000:3.0:1788572062.828064:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518331904 00000100:00100000:3.0:1788572062.828118:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788572062.828129:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518331904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572062.828294:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518331904:12345-0@lo:400:kworker.0 Request processed in 167us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572062.828350:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788572062.831355:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788572062.831371:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518332544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572062.831453:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518332544:12345-0@lo:400:kworker.0 Request processed in 87us (5910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572062.831460:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788572062.838437:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572062.838623:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518331904:0@lo:400:kworker.0 00010000:00080000:1.0:1788572062.838654:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0502f2300 x1875453518332544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572062.838666:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518332544:0@lo:400:kworker.0 00000100:00100000:1.0:1788572063.060810:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572063.060848:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572063.060870:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572063.060894:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495228032 00000100:00100000:1.0:1788572063.060903:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495228032 00000100:00100000:1.0:1788572063.060944:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 229 00000100:00100000:1.0:1788572063.060954:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495228032:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572063.061034:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495228032:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 81us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572063.061042:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 229 00000100:00100000:1.0:1788572063.061073:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495228160 00000100:00100000:1.0:1788572063.061076:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495228160 00000100:00100000:1.0:1788572063.061107:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495228288 00000100:00100000:1.0:1788572063.061110:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495228288 00000100:00100000:1.0:1788572063.061132:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:1.0:1788572063.061139:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495228160:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572063.061166:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495228160:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572063.061172:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:1.0:1788572063.061184:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:1.0:1788572063.061189:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495228288:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572063.061212:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495228288:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572063.061228:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00080000:1.0:1788572063.061484:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572063.070009:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572063.070047:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572063.070108:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495228416 00000100:00100000:1.0:1788572063.070117:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495228416 00000100:00100000:1.0:1788572063.070178:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495228544 00000100:00100000:1.0:1788572063.070182:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495228544 00000100:00100000:1.0:1788572063.070201:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:1.0:1788572063.070211:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2352:x1875453495228416:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:1.0:1788572063.070242:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff66a 00000100:00080000:1.0:1788572063.070284:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88bf45308000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572063.070387:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788572063.070704:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+2:2352:x1875453495228416:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 493us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572063.070712:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:1.0:1788572063.070784:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1788572063.070793:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2352:x1875453495228544:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:1.0:1788572063.070806:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff671 00000100:00080000:1.0:1788572063.070811:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88bf45319000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572063.070832:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788572063.071004:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+2:2352:x1875453495228544:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 201us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572063.071011:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00010000:00010000:1.0:1788572063.071033:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572063.071144:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572063.071243:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572063.071268:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572063.336503:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572063.336526:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518332672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572063.336607:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572063.336713:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518332672 00000100:00100000:3.0:1788572063.336721:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518332672 00000100:00100000:3.0:1788572063.336773:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788572063.336783:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518332672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572063.336816:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572063.336862:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518332672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572063.336869:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788572063.336905:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764ba680 x1875453518332672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572063.336922:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518332672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572063.465492:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572063.849293:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518332800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572063.849368:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572063.849453:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518332800 00000100:00100000:3.0:1788572063.849461:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518332800 00000100:00100000:3.0:1788572063.849506:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788572063.849514:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518332800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572063.849547:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572063.849589:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518332800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572063.849595:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788572063.849635:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0502f3480 x1875453518332800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572063.849653:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518332800:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788572063.900954:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a29edff0-34e1-4cac-beac-cd8589fdf9ee 00000020:00000080:3.0:1788572063.900972:0:7635:0:(genops.c:885:class_export_put()) final put ffff88bf4531c000/a29edff0-34e1-4cac-beac-cd8589fdf9ee 00000020:00000080:3.0:1788572063.901007:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531c000/a29edff0-34e1-4cac-beac-cd8589fdf9ee for lustre-OST0001 00000020:00000080:3.0:1788572063.901066:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88bf45319000 for lustre-OST0001 00000001:00100000:2.0:1788572064.450946:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a29edff0-34e1-4cac-beac-cd8589fdf9ee 00000020:00000080:2.0:1788572064.450956:0:6703:0:(genops.c:885:class_export_put()) final put ffff88bf4530c000/a29edff0-34e1-4cac-beac-cd8589fdf9ee 00000020:00000080:2.0:1788572064.451503:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4530c000/a29edff0-34e1-4cac-beac-cd8589fdf9ee for lustre-OST0000 00000020:00000080:2.0:1788572064.451553:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88bf45308000 for lustre-OST0000 00010000:00010000:0.0:1788572064.490623:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572065.514268:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572066.536619:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572067.574241:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572067.632960:0:11016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788572067.945489:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518333312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572067.945562:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572067.945623:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572067.945630:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518333184:0@lo:400:kworker.0 00000100:00100000:3.0:1788572067.945670:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572067.945793:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518333056:0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.945833:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572067.945861:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518333568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.945881:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572067.945906:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788572067.945911:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518332928:0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.945936:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572067.945958:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518333440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.945976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572067.946002:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518333312 00000100:00100000:1.0:1788572067.946009:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518333312 00000100:00100000:1.0:1788572067.946064:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518333568 00000100:00100000:1.0:1788572067.946068:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518333568 00000100:00100000:1.0:1788572067.946088:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788572067.946096:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518333312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.946144:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518333312:12345-0@lo:400:kworker.0 Request processed in 49us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572067.946164:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788572067.946181:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788572067.946188:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518333568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.946217:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518333568:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572067.946223:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788572067.946239:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518333184 00000100:00100000:1.0:1788572067.946243:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518333184 00000100:00100000:1.0:1788572067.946288:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518333056 00000100:00100000:1.0:1788572067.946304:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518333056 00000100:00100000:1.0:1788572067.946319:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518333440 00000100:00100000:1.0:1788572067.946321:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518333440 00000100:00100000:1.0:1788572067.946334:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788572067.946340:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518333184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.946370:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518333184:12345-0@lo:400:kworker.0 Request processed in 30us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572067.946376:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788572067.946387:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788572067.946392:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518333056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.946417:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518333056:12345-0@lo:400:kworker.0 Request processed in 25us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572067.946423:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788572067.946433:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788572067.946440:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518333440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.946463:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518333440:12345-0@lo:400:kworker.0 Request processed in 25us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572067.946469:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788572067.946486:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518332928 00000100:00100000:1.0:1788572067.946490:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518332928 00000100:00100000:1.0:1788572067.946514:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788572067.946522:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518332928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.946549:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518332928:12345-0@lo:400:kworker.0 Request processed in 29us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572067.946555:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:1.0:1788572067.946582:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572067.946587:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572067.946595:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572067.946631:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518332928:0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.946644:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518333440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.946653:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518333056:0@lo:400:kworker.0 00010000:00080000:1.0:1788572067.946666:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764ba300 x1875453518333568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572067.946678:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518333568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572067.946723:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518333184:0@lo:400:kworker.0 00010000:00080000:1.0:1788572067.946734:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764bb800 x1875453518333312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572067.946743:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518333312:0@lo:400:kworker.0 00000100:00100000:1.0:1788572068.187594:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572068.187646:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572068.187691:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572068.187841:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495228672 00000100:00100000:3.0:1788572068.187852:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495228672 00000100:00100000:3.0:1788572068.187910:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 231 00000100:00100000:3.0:1788572068.189668:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2354:x1875453495228672:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572068.189767:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2354:x1875453495228672:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 1845us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572068.189778:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 231 00000100:00100000:2.0:1788572068.190387:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495228928 00000100:00100000:2.0:1788572068.190397:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495228928 00000100:00100000:2.0:1788572068.190517:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495228800 00000100:00100000:2.0:1788572068.190522:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495228800 00000100:00100000:2.0:1788572068.190554:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:2.0:1788572068.190563:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495228928:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572068.190610:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495228928:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 49us (2963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572068.190617:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:2.0:1788572068.190656:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1788572068.190663:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495228800:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572068.190687:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495228800:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572068.190693:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00080000:3.0:1788572068.193557:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572068.462530:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518333696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572068.462603:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572068.462696:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518333696 00000100:00100000:1.0:1788572068.462705:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518333696 00000100:00100000:1.0:1788572068.462753:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788572068.462764:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518333696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572068.462831:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572068.462878:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518333696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572068.462904:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788572068.462950:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076234a80 x1875453518333696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572068.462971:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518333696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572068.584632:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572068.976636:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518333824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572068.976703:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572068.976790:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518333824 00000100:00100000:3.0:1788572068.976798:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518333824 00000100:00100000:3.0:1788572068.978442:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788572068.978462:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518333824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572068.978503:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572068.978574:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518333824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572068.978595:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788572068.978653:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764bbb80 x1875453518333824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572068.978674:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518333824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572069.615400:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572070.650966:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572071.660930:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788572072.025087:0:11165:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5af35e70 20000000:00000080:1.0:1788572072.025105:0:11165:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88c07baa0400 uarg=0000000000000000 20000000:01000000:1.0:1788572072.025208:0:11165:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788572072.025214:0:11165:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788572072.025218:0:11165:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788572072.026215:0:11166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788572072.027555:0:11165:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788572072.033973:0:11165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788572072.034065:0:11165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034084:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff61d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034093:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff62b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034100:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff639 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034108:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d8e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034115:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dc6 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034121:0:11165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034173:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dc6 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034188:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dc6 expref: 12 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572072.034203:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518333952:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572072.034741:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d8e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034751:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d8e expref: 12 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572072.034760:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518334080:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572072.034975:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff639 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.034983:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff639 expref: 18 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572072.034991:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518334208:0@lo:104: 00000100:00100000:0.0:1788572072.035054:0:11165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572072.035099:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff62b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.035107:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff62b expref: 18 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572072.035125:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518334336:0@lo:104: 00000100:00100000:0.0:1788572072.035146:0:11165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572072.035175:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff61d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.035183:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff61d expref: 18 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572072.035190:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518334464:0@lo:104: 00000100:00100000:0.0:1788572072.035209:0:11165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572072.035227:0:11165:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572072.035368:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518334208 00000100:00100000:3.0:1788572072.035383:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518334208 00000100:00100000:3.0:1788572072.035419:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518334336 00000100:00100000:3.0:1788572072.035422:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518334336 00000100:00100000:3.0:1788572072.035430:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518334464 00000100:00100000:3.0:1788572072.035433:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518334464 00000100:00100000:3.0:1788572072.035445:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788572072.035454:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:11165:x1875453518334208:12345-0@lo:104: 00010000:00010000:3.0:1788572072.035467:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.035516:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572072.035522:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+5:11165:x1875453518334208:12345-0@lo:104: Request processed in 69us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572072.035529:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788572072.035543:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572072.035549:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:11165:x1875453518334336:12345-0@lo:104: 00010000:00010000:3.0:1788572072.035556:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.035587:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788572072.035598:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:11165:x1875453518334336:12345-0@lo:104: Request processed in 49us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572072.035603:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572072.035614:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788572072.035619:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:11165:x1875453518334464:12345-0@lo:104: 00010000:00010000:3.0:1788572072.035626:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.035674:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788572072.035689:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:11165:x1875453518334464:12345-0@lo:104: Request processed in 71us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572072.035694:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788572072.035710:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572072.035716:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.035723:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572072.035726:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.035734:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572072.035741:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572072.035746:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572072.036008:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036025:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572072.036042:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036048:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387200/0x977d9e7969bff639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff640 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036060:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572072.036063:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036068:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db2a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572072.036071:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036078:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572072.036084:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572072.036089:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572072.036102:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036108:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572072.036114:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036119:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c046db2a00/0x977d9e7969bff62b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff632 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036134:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572072.036137:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036142:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572072.036145:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036151:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572072.036157:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572072.036161:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572072.036173:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036179:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572072.036193:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036199:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c058a0c600/0x977d9e7969bff61d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff624 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572072.036211:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572072.036212:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572072.036214:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572072.036228:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518334848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572072.036306:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572072.036414:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572072.036425:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518334592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572072.036454:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572072.036479:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572072.036484:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518334720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572072.036503:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572072.036526:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518334848 00000100:00100000:2.0:1788572072.036531:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518334848 00010000:00010000:2.0:1788572072.036552:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff61d expref: 19 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572072.036566:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518334592 00000100:00100000:2.0:1788572072.036568:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518334592 00010000:00010000:2.0:1788572072.036577:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff639 expref: 20 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572072.036586:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518334720 00000100:00100000:2.0:1788572072.036589:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518334720 00010000:00010000:2.0:1788572072.036599:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff62b expref: 21 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572072.036611:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788572072.036617:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058e7d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+21:3297:x1875453518334848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572072.036644:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572072.036650:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff61d expref: 21 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572072.036660:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff61d expref: 21 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572072.036834:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572072.036941:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058e7d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+21:3297:x1875453518334848:12345-0@lo:103:ldlm_bl.0 Request processed in 322us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572072.036947:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788572072.036991:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788572072.036997:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+20:3299:x1875453518334592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572072.037003:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572072.037008:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff639 expref: 20 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572072.037016:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff639 expref: 20 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572072.037026:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572072.037051:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+20:3299:x1875453518334592:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572072.037058:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788572072.037069:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788572072.037075:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518334720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572072.037082:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572072.037086:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff62b expref: 19 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572072.037099:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff62b expref: 19 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572072.037108:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572072.037128:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518334720:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572072.037134:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788572072.037170:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518334848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572072.037195:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518334720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572072.037202:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518334592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572072.037354:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387000/0x977d9e7969bff640 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff639 expref: 18 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572072.037365:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518334208:0@lo:104: 00010000:00010000:0.0:1788572072.037383:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3000/0x977d9e7969bff632 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff62b expref: 17 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572072.037391:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518334336:0@lo:104: 00010000:00010000:0.0:1788572072.037401:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b90000/0x977d9e7969bff624 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff61d expref: 16 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572072.037407:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518334464:0@lo:104: 00010000:00010000:0.0:1788572072.037551:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572072.043345:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572072.043417:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572072.043442:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495229056 00000100:00100000:1.0:1788572072.043450:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495229056 00010000:00010000:1.0:1788572072.043490:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dc6 expref: 13 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572072.043518:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495229184 00000100:00100000:1.0:1788572072.043521:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495229184 00010000:00010000:1.0:1788572072.043532:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d8e expref: 14 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572072.043544:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:1.0:1788572072.043552:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+14:2356:x1875453495229056:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572072.043564:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572072.043582:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dc6 expref: 14 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.043595:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dc6 expref: 14 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.043616:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572072.043715:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788572072.043723:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788572072.044591:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2800/0x977d9e7969bff65c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dc6 expref: 14 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572072.044609:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518333952:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572072.044645:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875453518334080:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572072.044677:0:11165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572072.044983:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495229056:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 1429us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572072.044992:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:1.0:1788572072.045018:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:1.0:1788572072.045029:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+12:2356:x1875453495229184:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572072.045042:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572072.045048:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d8e expref: 12 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045058:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d8e expref: 12 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045072:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff647 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d8e expref: 12 pid: 5825 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045085:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045093:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045106:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045124:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045140:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045147:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045154:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572072.045158:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045166:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045178:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572072.045188:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572072.045409:0:11165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.045417:0:11165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572072.045423:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b90400/0x977d9e7969bff678 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572072.048921:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+11:2356:x1875453495229184:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 3886us (5494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572072.048936:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00010000:00010000:3.0:1788572072.680678:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572073.066195:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518334976:0@lo:400:kworker.0 00000100:00100000:3.0:1788572073.066289:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572073.066498:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518334976 00000100:00100000:2.0:1788572073.066507:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518334976 00000100:00100000:2.0:1788572073.066568:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788572073.066578:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3298:x1875453518334976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572073.066773:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518335232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572073.067139:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572073.067187:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572073.067194:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518335104:0@lo:400:kworker.0 00000100:00100000:0.0:1788572073.067227:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572073.067280:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518335232 00000100:00100000:0.0:1788572073.067285:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518335232 00000100:00100000:0.0:1788572073.067334:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518335104 00000100:00100000:2.0:1788572073.068743:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3298:x1875453518334976:12345-0@lo:400:kworker.0 Request processed in 2159us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572073.068763:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788572073.069196:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518335360:0@lo:400:kworker.0 00000100:00100000:1.0:1788572073.069266:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572073.069295:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572073.069301:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf45197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518335488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572073.069324:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572073.069723:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518334976:0@lo:400:kworker.0 00000100:00080000:3.0:1788572073.069785:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572073.070144:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518335104 00000100:00100000:0.0:1788572073.070196:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788572073.070204:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518335232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572073.070271:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518335232:12345-0@lo:400:kworker.0 Request processed in 68us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572073.070277:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788572073.070295:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788572073.070301:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518335104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572073.071701:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518335616:0@lo:400:kworker.0 00000100:00100000:2.0:1788572073.072057:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518335488 00000100:00100000:2.0:1788572073.072065:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518335488 00000100:00100000:2.0:1788572073.072110:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788572073.072118:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518335488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572073.072180:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518335488:12345-0@lo:400:kworker.0 Request processed in 62us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572073.072186:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1788572073.072561:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572073.074139:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518335360 00000100:00100000:3.0:1788572073.074151:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518335360 00000100:00100000:3.0:1788572073.074207:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788572073.074216:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518335360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572073.074297:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518335360:12345-0@lo:400:kworker.0 Request processed in 83us (5030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572073.074304:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788572073.074323:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572073.077223:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518335104:12345-0@lo:400:kworker.0 Request processed in 6914us (9998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572073.077237:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788572073.079183:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518335488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572073.081065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572073.081130:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518335616 00000100:00100000:1.0:1788572073.081138:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518335616 00000100:00100000:1.0:1788572073.081191:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788572073.081200:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518335616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572073.081269:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518335616:12345-0@lo:400:kworker.0 Request processed in 70us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.081275:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788572073.081298:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788572073.081323:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c554700 x1875453518335616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572073.081336:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518335616:0@lo:400:kworker.0 00000100:00100000:2.0:1788572073.081474:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518335232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572073.084190:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518335104:0@lo:400:kworker.0 00010000:00080000:0.0:1788572073.089184:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf45196d80 x1875453518335360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572073.089201:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf45196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518335360:0@lo:400:kworker.0 00000100:00100000:1.0:1788572073.108183:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572073.117184:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495229312 00000100:00100000:3.0:1788572073.117200:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495229312 00000100:00100000:1.0:1788572073.117553:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 233 00000100:00100000:1.0:1788572073.117566:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+11:5597:x1875453495229312:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572073.117582:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572073.117610:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10df0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.117639:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.117651:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.117668:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2200, rc 0) 00000100:00100000:1.0:1788572073.117738:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495229312:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 176us (9563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.117746:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 233 00000100:00100000:3.0:1788572073.126272:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572073.126335:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495229440 00000100:00100000:1.0:1788572073.126344:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495229440 00000100:00100000:1.0:1788572073.126403:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:1.0:1788572073.126413:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495229440:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572073.126740:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495229440:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 327us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.126749:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:0.0:1788572073.130203:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572073.130275:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495229568 00000100:00100000:1.0:1788572073.130284:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495229568 00000100:00100000:1.0:1788572073.130335:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 235 00000100:00100000:1.0:1788572073.130344:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495229568:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572073.130780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495229568:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 435us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.130788:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 235 00000100:00100000:3.0:1788572073.135922:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572073.136143:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495229696 00000100:00100000:1.0:1788572073.136152:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495229696 00000100:00100000:1.0:1788572073.136199:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 236 00000100:00100000:1.0:1788572073.136209:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495229696:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572073.136225:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572073.136242:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10df7 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.136297:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df7 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.136318:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df7 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.136328:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2800, rc 0) 00000100:00100000:1.0:1788572073.136375:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495229696:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 167us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.136382:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 236 00000100:00100000:3.0:1788572073.141195:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572073.141401:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495229824 00000100:00100000:1.0:1788572073.141411:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495229824 00000100:00100000:1.0:1788572073.141693:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 237 00000100:00100000:1.0:1788572073.141705:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495229824:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572073.142005:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495229824:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 302us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.142013:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 237 00000100:00100000:0.0:1788572073.149390:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572073.149540:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495229952 00000100:00100000:3.0:1788572073.149549:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495229952 00000100:00100000:2.0:1788572073.150039:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00100000:2.0:1788572073.150050:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495229952:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572073.150295:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495229952:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 245us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572073.150303:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00100000:2.0:1788572073.316085:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572073.316315:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572073.316768:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495230208 00000100:00100000:3.0:1788572073.316779:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495230208 00000100:00100000:1.0:1788572073.316801:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495230080 00000100:00100000:1.0:1788572073.316805:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495230080 00000100:00100000:3.0:1788572073.316850:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:3.0:1788572073.316860:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495230208:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572073.316903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:1.0:1788572073.316910:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495230080:12345-192.168.202.2@tcp:400:kworker.0 00000100:00080000:2.0:1788572073.317005:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572073.317043:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495230208:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 184us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572073.317050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:1.0:1788572073.321606:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495230080:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 4683us (5430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.321621:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:1.0:1788572073.576401:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572073.576424:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518335744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572073.576489:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572073.576598:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518335744 00000100:00100000:1.0:1788572073.576606:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518335744 00000100:00100000:1.0:1788572073.576653:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788572073.576662:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518335744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572073.576696:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572073.576741:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518335744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.576747:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788572073.576787:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c554700 x1875453518335744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572073.576970:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518335744:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788572073.579725:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572073.579735:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c07bb14000 from 7 10000000:01000000:1.0:1788572073.579741:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572073.579794:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.580205:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.580219:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572073.584115:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518335872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572073.584231:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572073.584293:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052078900 going to sleep for 11 seconds 00000100:00100000:1.0:1788572073.584320:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518335872 00000100:00100000:1.0:1788572073.584327:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518335872 00000100:00100000:1.0:1788572073.584373:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788572073.584390:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518335872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572073.584405:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572073.584424:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff68d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.584449:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff68d expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.584460:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff68d expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.584470:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db3800, rc 0) 00000100:00100000:1.0:1788572073.584505:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518335872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.584511:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788572073.584842:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518335872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572073.584859:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.584869:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572073.584931:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572073.584957:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572073.584981:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052078900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572073.585075:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518336000 00000100:00100000:0.0:1788572073.585080:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518336000 00000100:00100000:0.0:1788572073.585112:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788572073.585119:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518336000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.585405:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518336000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572073.585413:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788572073.585443:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.585471:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.585506:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572073.585532:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572073.585544:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518336128 00000100:00100000:0.0:1788572073.585548:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518336128 00000100:00100000:0.0:1788572073.585568:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788572073.585585:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518336128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.585724:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518336128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572073.585731:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788572073.585767:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572073.586479:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788572073.586535:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788572073.586556:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572073.586565:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572073.586585:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572073.586596:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788572073.586599:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c0503c8800 from 7 10000000:01000000:0.0:1788572073.586602:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788572073.586629:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572073.586637:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572073.586647:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572073.586665:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.586705:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572073.586726:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572073.586751:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518336256 00000100:00100000:0.0:1788572073.586756:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518336256 00000100:00100000:0.0:1788572073.586789:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788572073.586797:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518336256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572073.586808:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572073.586821:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff69b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572073.586843:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff69b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572073.586854:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff69b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572073.586862:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90800, rc 0) 00000100:00100000:0.0:1788572073.586895:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518336256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572073.586901:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788572073.586940:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572073.586952:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572073.586961:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572073.587000:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.587023:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572073.587036:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572073.587051:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518336384 00000100:00100000:0.0:1788572073.587055:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518336384 00000100:00100000:0.0:1788572073.587075:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788572073.587081:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518336384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.587291:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518336384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572073.587298:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788572073.587325:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.587348:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.587378:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572073.587390:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572073.587400:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518336512 00000100:00100000:0.0:1788572073.587403:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518336512 00000100:00100000:0.0:1788572073.587421:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788572073.587426:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518336512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572073.587540:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518336512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572073.587546:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788572073.587593:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572073.589066:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788572073.589384:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788572073.589406:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788572073.589416:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.589438:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572073.589448:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572073.589450:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c065ad2800 from 7 10000000:01000000:1.0:1788572073.589453:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572073.589482:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.589491:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.589501:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572073.589535:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572073.589602:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572073.589636:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052078780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572073.589735:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518336640 00000100:00100000:2.0:1788572073.589743:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518336640 00000100:00100000:2.0:1788572073.589787:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788572073.589796:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518336640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572073.589817:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572073.589829:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff6a9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572073.589851:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff6a9 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572073.589861:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff6a9 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572073.589870:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572073.589910:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518336640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572073.589922:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788572073.589958:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572073.589969:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572073.589977:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572073.590017:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572073.590041:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572073.590054:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572073.590065:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518336768 00000100:00100000:2.0:1788572073.590068:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518336768 00000100:00100000:2.0:1788572073.590086:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788572073.590091:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518336768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572073.590419:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518336768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572073.590427:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788572073.590455:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572073.590480:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572073.591937:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572073.592030:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572073.597896:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518336896 00000100:00100000:1.0:1788572073.597910:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518336896 00000100:00100000:1.0:1788572073.597975:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788572073.597986:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518336896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572073.598442:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518336896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 457us (7926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572073.598450:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788572073.598558:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518336896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572073.599939:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788572073.607759:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788572073.607796:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788572073.607940:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572073.607964:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572073.708317:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572074.089415:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518337024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572074.089478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572074.089564:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518337024 00000100:00100000:1.0:1788572074.089572:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518337024 00000100:00100000:1.0:1788572074.089615:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788572074.089624:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518337024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572074.089655:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572074.089696:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518337024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572074.089703:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788572074.089743:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c554700 x1875453518337024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572074.089761:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518337024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572074.728666:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572075.752447:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572076.622000:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788572076.781795:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572077.800440:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572078.187239:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518337152:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.187328:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572078.187372:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518337664:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.187408:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572078.187445:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572078.187451:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518337536:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.187477:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572078.187505:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518337280:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.187527:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572078.187542:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518337792:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.187560:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572078.187577:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572078.187582:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518337408:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.187603:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572078.187651:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518337664 00000100:00100000:3.0:1788572078.187659:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518337664 00000100:00100000:3.0:1788572078.187718:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518337280 00000100:00100000:3.0:1788572078.187722:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518337280 00000100:00100000:3.0:1788572078.187735:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518337408 00000100:00100000:3.0:1788572078.187738:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518337408 00000100:00100000:3.0:1788572078.187752:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788572078.187760:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518337664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.187821:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518337664:12345-0@lo:400:kworker.0 Request processed in 60us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572078.187828:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788572078.187845:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788572078.187852:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518337280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.187883:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518337280:12345-0@lo:400:kworker.0 Request processed in 32us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572078.187889:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788572078.187901:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788572078.187908:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518337408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.187932:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518337408:12345-0@lo:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572078.187938:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788572078.187954:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518337536 00000100:00100000:3.0:1788572078.187957:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518337536 00000100:00100000:3.0:1788572078.187982:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518337792 00000100:00100000:3.0:1788572078.187985:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518337792 00000100:00100000:3.0:1788572078.188000:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788572078.188005:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518337536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.188034:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518337536:12345-0@lo:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572078.188040:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788572078.188051:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788572078.188057:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518337792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.188082:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518337792:12345-0@lo:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572078.188096:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788572078.188122:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572078.188126:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572078.188128:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788572078.188160:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764b8e00 x1875453518337536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572078.188173:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518337536:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.188184:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518337664:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.188215:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518337408:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.188224:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518337280:0@lo:400:kworker.0 00010000:00080000:3.0:1788572078.188232:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764bb800 x1875453518337792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572078.188240:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518337792:0@lo:400:kworker.0 00000100:00100000:1.0:1788572078.188817:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518337152 00000100:00100000:1.0:1788572078.188825:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518337152 00000100:00100000:1.0:1788572078.188864:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788572078.188872:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518337152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572078.188936:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518337152:12345-0@lo:400:kworker.0 Request processed in 65us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572078.188943:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788572078.188992:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518337152:0@lo:400:kworker.0 00000100:00100000:3.0:1788572078.431095:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572078.431135:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572078.431165:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572078.431193:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495230464 00000100:00100000:3.0:1788572078.431204:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495230464 00000100:00100000:3.0:1788572078.431287:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495230592 00000100:00100000:3.0:1788572078.431290:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495230592 00000100:00100000:3.0:1788572078.431311:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:3.0:1788572078.431319:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495230464:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572078.431409:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495230464:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572078.431442:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:3.0:1788572078.431460:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:3.0:1788572078.431465:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495230592:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572078.431486:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495230592:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572078.431492:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00080000:3.0:1788572078.431505:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572078.434700:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495230336 00000100:00100000:0.0:1788572078.434718:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495230336 00000100:00100000:0.0:1788572078.436465:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 249 00000100:00100000:0.0:1788572078.436504:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495230336:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572078.436600:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495230336:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 103us (5513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572078.436618:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 249 00000100:00100000:3.0:1788572078.700028:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518337920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572078.700106:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572078.702098:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518337920 00000100:00100000:0.0:1788572078.702114:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518337920 00000100:00100000:0.0:1788572078.702172:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788572078.702182:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518337920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572078.702223:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572078.702315:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518337920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572078.702322:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788572078.702395:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c35ce00 x1875453518337920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572078.702415:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518337920:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572078.834553:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572079.213973:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518338048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572079.214042:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572079.214114:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518338048 00000100:00100000:1.0:1788572079.214122:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518338048 00000100:00100000:1.0:1788572079.214169:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788572079.214178:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518338048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572079.214213:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572079.216833:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518338048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2647us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572079.216847:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788572079.216910:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050633800 x1875453518338048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572079.216933:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518338048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572079.849096:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572080.872818:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572081.175793:0:11464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:34:39 (1788572079) === 00000100:00100000:0.0:1788572081.443371:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572081.443483:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572081.444722:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495230720 00000100:00100000:3.0:1788572081.444735:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495230720 00000100:00100000:3.0:1788572081.444819:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788572081.444830:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495230720:12345-192.168.202.2@tcp:41:mkdir.0 00000004:00000024:3.0:1788572081.444874:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788572081.444960:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495230720:12345-192.168.202.2@tcp:41:mkdir.0 Request processed in 131us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572081.444969:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00080000:0.0:1788572081.445346:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572081.445478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495230848 00000100:00100000:1.0:1788572081.445483:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495230848 00000100:00100000:1.0:1788572081.445513:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788572081.445520:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:78708c10-ef63-4de2-8b1c-aff484c98227+6:9711:x1875453495230848:12345-192.168.202.2@tcp:700:mkdir.0 00000100:00100000:1.0:1788572081.445827:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:78708c10-ef63-4de2-8b1c-aff484c98227+6:9711:x1875453495230848:12345-192.168.202.2@tcp:700:mkdir.0 Request processed in 304us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572081.445834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1788572081.452291:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572081.452340:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495231104 00000100:00100000:3.0:1788572081.452350:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495231104 00000100:00100000:3.0:1788572081.452401:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1788572081.452411:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:9711:x1875453495231104:12345-192.168.202.2@tcp:36:mkdir.0 00010000:00010000:3.0:1788572081.452464:0:10431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572081.452914:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969bff598 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d79 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.452933:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd100) 00010000:00010000:3.0:1788572081.452945:0:10431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572081.453342:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.453358:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.453368:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.453399:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.453406:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.453412:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572081.470987:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788572081.471011:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.471024:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.471032:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.471055:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572081.471060:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.471067:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.471086:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572081.471089:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572081.471094:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.471101:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572081.471126:0:10431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9c7206a reply state 00000000e8733f92 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572081.471135:0:10431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572081.471290:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:9711:x1875453495231104:12345-192.168.202.2@tcp:36:mkdir.0 Request processed in 18876us (19008us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788572081.471299:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00010000:00010000:2.0:1788572081.480128:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.480161:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.480169:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.480175:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.480179:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.480187:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.480206:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88c059bcd200) 00010000:00010000:2.0:1788572081.480209:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572081.480213:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.480219:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6be lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572081.502962:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572081.505445:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495231232 00000100:00100000:3.0:1788572081.505463:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495231232 00000100:00100000:3.0:1788572081.505530:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1788572081.505540:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:9712:x1875453495231232:12345-192.168.202.2@tcp:101:chmod.0 00010000:00010000:3.0:1788572081.505562:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572081.505587:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10dfe expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.505668:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.505685:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.505697:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572081.505739:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572081.505744:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572081.505785:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.505810:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dfe expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.505828:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dfe expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.505837:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572081.505839:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572081.505843:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386800, rc 0) 00000100:00100000:3.0:1788572081.505916:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:9712:x1875453495231232:12345-192.168.202.2@tcp:101:chmod.0 Request processed in 377us (2965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572081.505923:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1788572081.517682:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572081.517881:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495231488 00000100:00100000:1.0:1788572081.517892:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495231488 00000100:00100000:1.0:1788572081.517950:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1788572081.517962:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:9712:x1875453495231488:12345-192.168.202.2@tcp:36:chmod.0 00010000:00010000:1.0:1788572081.518029:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572081.518059:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dfe expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572081.518087:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:1.0:1788572081.518097:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572081.518126:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572081.518139:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572081.518149:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572081.518483:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b91fdd6 reply state 00000000e3530e94 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572081.518494:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788572081.518502:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788572081.520080:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+8:9712:x1875453495231488:12345-192.168.202.2@tcp:36:chmod.0 Request processed in 2111us (2399us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788572081.520101:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00010000:00010000:2.0:1788572081.525649:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.525690:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.525699:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.525704:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db2a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.525725:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.525734:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.525769:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eacf00) 00010000:00010000:2.0:1788572081.525772:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572081.525790:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.525796:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff6d3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572081.556505:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572081.556802:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495231616 00000100:00100000:3.0:1788572081.556813:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495231616 00000100:00100000:3.0:1788572081.556889:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788572081.556898:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:9713:x1875453495231616:12345-192.168.202.2@tcp:101:chown.0 00010000:00010000:3.0:1788572081.556921:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572081.556942:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e05 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.557005:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff6e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.557020:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.557031:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572081.557066:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572081.557070:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572081.557104:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.557129:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff6da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e05 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.557161:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e05 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.557170:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd100) 00010000:00010000:3.0:1788572081.557172:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572081.557175:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387600, rc 0) 00000100:00100000:3.0:1788572081.557239:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+8:9713:x1875453495231616:12345-192.168.202.2@tcp:101:chown.0 Request processed in 342us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572081.557313:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:1.0:1788572081.559748:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572081.559937:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495231744 00000100:00100000:3.0:1788572081.559948:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495231744 00000100:00100000:3.0:1788572081.560000:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1788572081.560011:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+8:9713:x1875453495231744:12345-192.168.202.2@tcp:101:chown.0 00010000:00010000:3.0:1788572081.560031:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572081.560051:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff6e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e0c expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560117:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560142:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560155:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560169:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560176:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560182:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560331:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff6fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560359:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff6fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560365:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff6fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572081.560395:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572081.560399:0:10431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572081.560421:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff6fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560433:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560439:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560445:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560450:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572081.560455:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560463:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560475:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd100) 00010000:00010000:3.0:1788572081.560478:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572081.560494:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560511:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff6ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560527:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560533:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560538:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560543:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572081.560546:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560552:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560560:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88c059bcd500) 00010000:00010000:3.0:1788572081.560563:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572081.560566:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560572:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff6f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560603:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff6e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e0c expref: 10 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560616:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff6fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e0c expref: 9 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.560629:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c059bcda00) 00010000:00010000:3.0:1788572081.560631:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572081.560634:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387000, rc 0) 00000100:00100000:3.0:1788572081.560690:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+9:9713:x1875453495231744:12345-192.168.202.2@tcp:101:chown.0 Request processed in 680us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572081.560697:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788572081.572014:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572081.572071:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495232000 00000100:00100000:3.0:1788572081.572083:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495232000 00000100:00100000:3.0:1788572081.572238:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1788572081.572282:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+9:9713:x1875453495232000:12345-192.168.202.2@tcp:36:chown.0 00010000:00010000:3.0:1788572081.572355:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572081.572645:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff6fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e0c expref: 9 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.572664:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c059bcda00) 00010000:00010000:3.0:1788572081.572673:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572081.572698:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.572709:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.572716:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572081.620666:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1788572081.620860:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788572081.620920:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac15c79e reply state 000000003598c12b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572081.620951:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788572081.620964:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788572081.621101:0:5831:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788572081.621150:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:9713:x1875453495232000:12345-192.168.202.2@tcp:36:chown.0 Request processed in 48898us (49139us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788572081.621159:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:2.0:1788572081.628507:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.628528:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.628536:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.628542:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.628547:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.628556:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.628595:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c059bcd500) 00010000:00010000:2.0:1788572081.628598:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572081.628603:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.628610:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bff704 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572081.639520:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572081.640017:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495232128 00000100:00100000:3.0:1788572081.640029:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495232128 00000100:00100000:3.0:1788572081.640099:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788572081.640111:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:9714:x1875453495232128:12345-192.168.202.2@tcp:101:touch.500 00010000:00010000:3.0:1788572081.640147:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572081.640169:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff70b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e13 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572081.643697:0:10431:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3471us 00010000:00010000:2.0:1788572081.655240:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655288:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655308:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655329:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655336:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655342:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655699:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff720 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655710:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655724:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572081.655751:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788572081.655755:0:10431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572081.655793:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655808:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655816:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655824:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655831:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.655836:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655843:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655855:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd100) 00010000:00010000:2.0:1788572081.655859:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572081.655863:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655871:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655893:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655899:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655906:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655911:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.655915:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655921:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655929:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88c0593efe00) 00010000:00010000:2.0:1788572081.655932:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572081.655935:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655941:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff719 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655975:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff70b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e13 expref: 8 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.655991:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e13 expref: 7 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.656008:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:2.0:1788572081.656011:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788572081.656013:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0cc00, rc 0) 00000100:00100000:2.0:1788572081.656088:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:9714:x1875453495232128:12345-192.168.202.2@tcp:101:touch.500 Request processed in 15978us (16578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572081.656098:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788572081.660998:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572081.661085:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495232384 00000100:00100000:2.0:1788572081.661095:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495232384 00000100:00100000:2.0:1788572081.661190:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:2.0:1788572081.661201:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:9714:x1875453495232384:12345-192.168.202.2@tcp:101:touch.500 00010000:00010000:2.0:1788572081.661222:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572081.661244:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bff727 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.661720:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.661737:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.661749:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.661812:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.661820:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.661838:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572081.662601:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788572081.662867:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff73c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.662880:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff73c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.662889:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff73c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.662926:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.662935:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.662942:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.662947:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.662952:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.662962:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.662975:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:2.0:1788572081.662978:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572081.662989:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.662996:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff72e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572081.663011:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ba864b1 reply state 00000000f7a70aa8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572081.663021:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572081.663057:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bff727 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e1a expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.663071:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff73c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e1a expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.663078:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:2.0:1788572081.663081:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572081.663083:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d200, rc 0) 00000100:00100000:2.0:1788572081.663162:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+10:9714:x1875453495232384:12345-192.168.202.2@tcp:101:touch.500 Request processed in 1963us (2173us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788572081.663171:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:1.0:1788572081.669150:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:2.0:1788572081.669920:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.669935:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.669943:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.669972:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0de00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.669977:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.669986:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.670003:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff88c0593ef400) 00010000:00010000:2.0:1788572081.670006:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572081.670011:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.670018:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bff735 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572081.670203:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495232640 00000100:00100000:0.0:1788572081.670213:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495232640 00000100:00100000:0.0:1788572081.670343:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1788572081.670361:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:9714:x1875453495232640:12345-192.168.202.2@tcp:36:touch.500 00010000:00010000:0.0:1788572081.670419:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572081.670439:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bff73c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e1a expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.670453:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:0.0:1788572081.670459:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572081.670512:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.670526:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.670537:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572081.670672:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020f352eb reply state 00000000e9efca57 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572081.670683:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572081.670790:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+10:9714:x1875453495232640:12345-192.168.202.2@tcp:36:touch.500 Request processed in 430us (1660us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788572081.670799:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1788572081.673589:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572081.673629:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495232768 00000100:00100000:0.0:1788572081.673639:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495232768 00000100:00100000:0.0:1788572081.673692:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:0.0:1788572081.673702:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+10:9714:x1875453495232768:12345-192.168.202.2@tcp:101:touch.500 00010000:00010000:0.0:1788572081.673726:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572081.673760:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969bff751 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e21 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.673818:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969bff751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e21 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.673831:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969bff751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e21 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.673851:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:0.0:1788572081.673854:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572081.673857:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90200, rc 0) 00000100:00100000:0.0:1788572081.673908:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+11:9714:x1875453495232768:12345-192.168.202.2@tcp:101:touch.500 Request processed in 207us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572081.673914:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00010000:00010000:3.0:1788572081.674202:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.674212:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.674219:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.674225:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572081.674229:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.674237:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.674288:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:3.0:1788572081.674291:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572081.674294:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572081.674301:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff74a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572081.676116:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572081.676863:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495232896 00000100:00100000:0.0:1788572081.676874:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495232896 00000100:00100000:0.0:1788572081.676923:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1788572081.676931:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875453495232896:12345-192.168.202.2@tcp:8:touch.500 00010000:00080000:0.0:1788572081.676962:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:0.0:1788572081.676992:0:6681:0:(genops.c:1385:class_connect()) connect: client 78708c10-ef63-4de2-8b1c-aff484c98227, cookie 0x977d9e7969bff758 00002000:00100000:0.0:1788572081.677002:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 78708c10-ef63-4de2-8b1c-aff484c98227/ffff88c07c3e2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572081.677023:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572081.677522:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788572081.677556:0:6681:0:(import.c:65:import_set_state_nolock()) ffff88c07c3e7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572081.677728:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2352:x1875453495232896:12345-192.168.202.2@tcp:8:touch.500 Request processed in 795us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572081.677756:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788572081.680384:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572081.680642:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495233024 00000100:00100000:3.0:1788572081.680652:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495233024 00000100:00100000:3.0:1788572081.680723:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:3.0:1788572081.680733:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:0:x1875453495233024:12345-192.168.202.2@tcp:2:touch.500 00000100:00080000:0.0:1788572081.681029:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572081.710937:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:0:x1875453495233024:12345-192.168.202.2@tcp:2:touch.500 Request processed in 30196us (30555us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788572081.710949:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000001:00100000:2.0:1788572081.711149:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000001:00080000:2.0:1788572081.711163:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788572081.713211:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572081.713391:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495233280 00000100:00100000:1.0:1788572081.713414:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495233280 00000100:00100000:1.0:1788572081.713465:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:1.0:1788572081.713475:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+10:9714:x1875453495233280:12345-192.168.202.2@tcp:35:touch.500 00000100:00100000:1.0:1788572081.713840:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+11:9714:x1875453495233280:12345-192.168.202.2@tcp:35:touch.500 Request processed in 365us (637us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788572081.713849:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:3.0:1788572081.726325:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572081.726426:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495233408 00000100:00100000:0.0:1788572081.726436:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495233408 00000100:00100000:0.0:1788572081.726508:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:0.0:1788572081.726520:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+11:9715:x1875453495233408:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:0.0:1788572081.726543:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572081.726566:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969bff75f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e28 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.726635:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.726649:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.726661:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572081.726695:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788572081.726698:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572081.726735:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.726761:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969bff75f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e28 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.726792:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e28 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.726821:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:0.0:1788572081.726824:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572081.726828:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90000, rc 0) 00000100:00100000:0.0:1788572081.726890:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+12:9715:x1875453495233408:12345-192.168.202.2@tcp:101:rm.0 Request processed in 372us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572081.726898:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788572081.731212:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572081.731420:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495233664 00000100:00100000:0.0:1788572081.731430:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495233664 00000100:00100000:2.0:1788572081.731569:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:2.0:1788572081.731581:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+12:9715:x1875453495233664:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:2.0:1788572081.731600:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572081.731621:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bff76d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e2f expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572081.731716:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788572081.731835:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bff76d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e2f expref: 14 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.731869:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd100) 00010000:00010000:2.0:1788572081.731872:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572081.731878:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bff76d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e2f expref: 14 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.731894:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0dc00, rc 0) 00000100:00100000:2.0:1788572081.731955:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+13:9715:x1875453495233664:12345-192.168.202.2@tcp:101:rm.0 Request processed in 376us (752us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788572081.731963:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:2.0:1788572081.736754:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572081.736893:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495233792 00000100:00100000:1.0:1788572081.736905:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495233792 00000100:00100000:1.0:1788572081.736965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1788572081.736976:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+13:9715:x1875453495233792:12345-192.168.202.2@tcp:37:rm.0 00000100:00100000:1.0:1788572081.742789:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+13:9715:x1875453495233792:12345-192.168.202.2@tcp:37:rm.0 Request processed in 5803us (6032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572081.742802:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:3.0:1788572081.746371:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572081.746497:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495234048 00000100:00100000:2.0:1788572081.746508:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495234048 00000100:00100000:2.0:1788572081.746573:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:2.0:1788572081.746584:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c06bdb4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+13:9715:x1875453495234048:12345-192.168.202.2@tcp:35:rm.0 00000100:00100000:2.0:1788572081.746846:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c06bdb4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+14:9715:x1875453495234048:12345-192.168.202.2@tcp:35:rm.0 Request processed in 263us (485us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788572081.746854:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:2.0:1788572081.749908:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572081.750004:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495234304 00000100:00100000:0.0:1788572081.750014:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495234304 00000100:00100000:0.0:1788572081.750077:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1788572081.750088:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+14:9715:x1875453495234304:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:0.0:1788572081.750113:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572081.750134:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff77b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e36 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.750233:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969bff782 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.750297:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969bff782 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.750310:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969bff782 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572081.750321:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788572081.750444:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff77b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e36 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.750498:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969bff782 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e36 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.750509:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:0.0:1788572081.750512:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788572081.750516:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91200, rc 0) 00000100:00100000:0.0:1788572081.750637:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+16:9715:x1875453495234304:12345-192.168.202.2@tcp:101:rm.0 Request processed in 550us (739us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788572081.750644:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1788572081.753891:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572081.753977:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495234432 00000100:00100000:2.0:1788572081.753986:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495234432 00000100:00100000:2.0:1788572081.754043:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:2.0:1788572081.754053:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+16:9715:x1875453495234432:12345-192.168.202.2@tcp:41:rm.0 00000004:00000024:2.0:1788572081.754113:0:10431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788572081.754195:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+16:9715:x1875453495234432:12345-192.168.202.2@tcp:41:rm.0 Request processed in 143us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572081.754217:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:1.0:1788572081.756616:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572081.756791:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495234560 00000100:00100000:0.0:1788572081.756801:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495234560 00000100:00100000:0.0:1788572081.756860:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:0.0:1788572081.756869:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+16:9715:x1875453495234560:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:0.0:1788572081.756891:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572081.756911:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff790 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e3d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.756974:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.756989:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757001:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757034:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757042:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757049:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757141:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969bff7a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757150:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969bff7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757158:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969bff7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572081.757183:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788572081.757187:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572081.757204:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969bff7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757215:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969bff7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757224:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757231:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757278:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757285:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572081.757644:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757655:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757668:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:0.0:1788572081.757672:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572081.757676:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757684:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff797 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757698:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757705:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757712:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757717:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572081.757720:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757738:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757746:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff88c0481bfe00) 00010000:00010000:0.0:1788572081.757748:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572081.757751:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757756:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff79e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757788:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff790 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e3d expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757803:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969bff7a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e3d expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.757811:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:0.0:1788572081.757813:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572081.757816:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b91e00, rc 0) 00000100:00100000:0.0:1788572081.757889:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+17:9715:x1875453495234560:12345-192.168.202.2@tcp:101:rm.0 Request processed in 1020us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572081.757897:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:3.0:1788572081.762887:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572081.762982:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495234816 00000100:00100000:2.0:1788572081.762992:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495234816 00000100:00100000:2.0:1788572081.763054:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1788572081.763065:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+17:9715:x1875453495234816:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:2.0:1788572081.763125:0:10431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788572081.763171:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91e00/0x977d9e7969bff7a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e3d expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763196:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90200/0x977d9e7969bff751 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e21 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763210:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572081.763225:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e28 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763233:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:2.0:1788572081.763237:0:10431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572081.763313:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763327:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763338:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763352:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763373:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763379:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763495:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763504:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.763511:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572081.764203:0:10431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788572081.764214:0:10431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302554965262ns, next at 303554962417ns, rc = 0 00010000:00010000:2.0:1788572081.764309:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764321:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764329:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764337:0:10431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764344:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764360:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764378:0:10431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572081.764397:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764403:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764409:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764414:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.764419:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764426:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764436:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:2.0:1788572081.764439:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572081.764442:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764449:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff7ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764466:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764471:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764482:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764487:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.764489:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764495:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764503:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:2.0:1788572081.764505:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572081.764507:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.764512:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff7ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572081.764521:0:10431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd3deab4 reply state 000000009ac58671 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572081.764529:0:10431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572081.764602:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+16:9715:x1875453495234816:12345-192.168.202.2@tcp:36:rm.0 Request processed in 1536us (1725us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788572081.764609:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00010000:00010000:1.0:1788572081.764900:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572081.764907:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572081.764913:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572081.764916:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572081.764922:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572081.764931:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88c0593efa00) 00010000:00010000:1.0:1788572081.764933:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788572081.764936:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572081.764947:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff7c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572081.764961:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572081.764963:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572081.764965:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572081.767667:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.767685:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.767711:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.767717:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.767722:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.767730:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.767746:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff88c0593ef900) 00010000:00010000:2.0:1788572081.767749:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572081.767753:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.767760:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff7b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572081.771214:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572081.771381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495235072 00000100:00100000:2.0:1788572081.771392:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495235072 00000100:00100000:2.0:1788572081.771439:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1788572081.771448:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+15:9715:x1875453495235072:12345-192.168.202.2@tcp:35:rm.0 00000100:00100000:2.0:1788572081.771676:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+16:9715:x1875453495235072:12345-192.168.202.2@tcp:35:rm.0 Request processed in 228us (472us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788572081.771684:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788572081.775086:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572081.775193:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495235328 00000100:00100000:0.0:1788572081.775204:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495235328 00000100:00100000:0.0:1788572081.775310:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:0.0:1788572081.775321:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+16:9715:x1875453495235328:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:0.0:1788572081.775378:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788572081.775419:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969bff782 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e36 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775441:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff720 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e13 expref: 15 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775455:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:0.0:1788572081.775473:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff6e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e05 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775493:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd100) 00010000:00010000:0.0:1788572081.775501:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572081.775527:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775541:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775551:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775563:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775571:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775577:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775832:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775848:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.775856:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572081.776446:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788572081.776462:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776469:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776475:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776481:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572081.776486:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776494:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776504:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88c0481bf900) 00010000:00010000:0.0:1788572081.776507:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572081.776511:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776517:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff7d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776536:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776548:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776554:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776559:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572081.776562:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776568:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776576:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:0.0:1788572081.776578:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572081.776581:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572081.776586:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff7c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572081.776598:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b387b41 reply state 00000000e1a1088a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572081.776607:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572081.776696:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+15:9715:x1875453495235328:12345-192.168.202.2@tcp:36:rm.0 Request processed in 1375us (1621us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788572081.776704:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00010000:00010000:2.0:1788572081.779961:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.779982:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.780007:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.780014:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572081.780020:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.780029:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.780048:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88c0481bf700) 00010000:00010000:2.0:1788572081.780052:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572081.780057:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.780065:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff7cf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572081.897048:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572082.923582:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572083.307858:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518338560:0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.307932:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572083.308002:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572083.308008:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518338176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308040:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572083.308065:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518338688:0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308088:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572083.308113:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518338304:0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308133:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572083.308149:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518338816:0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572083.308197:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572083.308202:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518338432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572083.308269:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518338560 00000100:00100000:0.0:1788572083.308275:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518338560 00000100:00100000:0.0:1788572083.308326:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518338816 00000100:00100000:0.0:1788572083.308330:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518338816 00000100:00100000:0.0:1788572083.308348:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788572083.308358:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518338560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308415:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518338560:12345-0@lo:400:kworker.0 Request processed in 59us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572083.308423:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788572083.308442:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572083.308448:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518338816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308490:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518338816:12345-0@lo:400:kworker.0 Request processed in 42us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572083.308496:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572083.308520:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518338176 00000100:00100000:0.0:1788572083.308534:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518338176 00000100:00100000:0.0:1788572083.308559:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788572083.308565:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518338176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308600:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518338176:12345-0@lo:400:kworker.0 Request processed in 35us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572083.308606:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788572083.308632:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518338688 00000100:00100000:0.0:1788572083.308636:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518338688 00000100:00100000:0.0:1788572083.308660:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518338304 00000100:00100000:0.0:1788572083.308663:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518338304 00000100:00100000:0.0:1788572083.308673:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518338432 00000100:00100000:0.0:1788572083.308675:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518338432 00000100:00100000:0.0:1788572083.308689:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788572083.308694:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518338688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308723:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518338688:12345-0@lo:400:kworker.0 Request processed in 28us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572083.308729:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788572083.308740:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788572083.308745:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518338304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308768:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518338304:12345-0@lo:400:kworker.0 Request processed in 23us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572083.308774:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788572083.308784:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788572083.308789:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518338432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308814:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518338432:12345-0@lo:400:kworker.0 Request processed in 25us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572083.308828:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788572083.308854:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572083.308858:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572083.308861:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572083.308897:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518338432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308907:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518338304:0@lo:400:kworker.0 00010000:00080000:0.0:1788572083.308917:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf46a67480 x1875453518338816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572083.308928:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518338816:0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308955:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518338176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572083.308965:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518338688:0@lo:400:kworker.0 00010000:00080000:0.0:1788572083.308974:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c35d180 x1875453518338560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572083.308982:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518338560:0@lo:400:kworker.0 00000100:00100000:3.0:1788572083.541516:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572083.541573:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495235584 00000100:00100000:0.0:1788572083.541583:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495235584 00000100:00100000:2.0:1788572083.541814:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572083.541849:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572083.541879:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572083.541903:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495235456 00000100:00100000:2.0:1788572083.541907:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495235456 00000100:00100000:2.0:1788572083.541959:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 251 00000100:00100000:2.0:1788572083.541969:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2355:x1875453495235456:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572083.542038:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2355:x1875453495235456:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572083.542064:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 251 00000100:00100000:2.0:1788572083.542103:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495235712 00000100:00100000:2.0:1788572083.542108:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495235712 00000100:00100000:0.0:1788572083.542109:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495235840 00000100:00100000:0.0:1788572083.542115:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495235840 00000100:00100000:3.0:1788572083.542239:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:3.0:1788572083.542742:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+14:2355:x1875453495235584:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572083.542793:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+14:2355:x1875453495235584:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 545us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572083.542801:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00080000:1.0:1788572083.543417:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572083.543424:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572083.543835:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1788572083.543846:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495235712:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572083.543900:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495235712:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 57us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572083.543908:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:0.0:1788572083.545478:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:0.0:1788572083.545493:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2355:x1875453495235840:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572083.545585:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2355:x1875453495235840:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 96us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572083.545592:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:0.0:1788572083.817372:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572083.817404:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518338944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572083.817472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572083.817535:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518338944 00000100:00100000:0.0:1788572083.817543:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518338944 00000100:00100000:0.0:1788572083.817589:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788572083.817598:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518338944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572083.817631:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572083.817811:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518338944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572083.817819:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788572083.817862:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf46a67480 x1875453518338944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572083.817880:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518338944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572083.944526:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572084.329165:0:7096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 305119913035ns, next at 306119910778ns, rc = 0 00000100:00100000:3.0:1788572084.329399:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518339072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572084.329476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572084.329545:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518339072 00000100:00100000:3.0:1788572084.329552:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518339072 00000100:00100000:3.0:1788572084.329596:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788572084.329605:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518339072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572084.329636:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572084.329689:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518339072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572084.329696:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788572084.329741:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c076235180 x1875453518339072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572084.329772:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518339072:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572084.969703:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572085.992663:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788572086.305415:0:11614:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1788572087.016967:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788572087.016993:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788572087.017011:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788572087.017287:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572087.017309:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518339200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572087.017370:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572087.019166:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518339200 00000100:00100000:0.0:1788572087.019183:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518339200 00000100:00100000:0.0:1788572087.019281:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788572087.019295:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518339200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572087.019329:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788572087.019366:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9b71b1, atime: 0x6a9b71b1, ctime: 0x6a9b71b1, blocks: 0x1 00010000:00010000:0.0:1788572087.019374:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.019385:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572087.019389:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788572087.019394:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572087.019400:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.019429:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.019440:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.019448:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.019464:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572087.020033:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518339200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 741us (2660us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788572087.020056:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788572087.020083:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572087.020090:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.020099:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572087.020103:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.020113:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.020130:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.020144:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ed4e8ea/0x977d9e7969bff7dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.020162:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572087.020164:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572087.020166:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572087.020207:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c076235180/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788572087.020213:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518339200:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788572087.021479:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788572087.781950:0:11665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7b0dc9a0 20000000:00000080:1.0:1788572087.781966:0:11665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88c07646ec00 uarg=0000000000000000 20000000:01000000:1.0:1788572087.782004:0:11665:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788572087.782023:0:11665:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788572087.782030:0:11665:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788572087.783812:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788572087.783989:0:11665:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788572087.789933:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788572087.789990:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788572087.790211:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788572087.790232:0:11665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788572087.790300:0:11665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.790324:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.790347:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df7 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.790355:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff68d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.790362:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff69b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.790369:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff6a9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.790375:0:11665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.790415:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff6a9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.790431:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff6a9 expref: 18 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572087.790445:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339328:0@lo:104: 00000100:00100000:3.0:1788572087.790526:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572087.790670:0:8504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518339328 00000100:00100000:0.0:1788572087.790677:0:8504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518339328 00000100:00100000:0.0:1788572087.790727:0:8504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788572087.790736:0:8504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:11665:x1875453518339328:12345-0@lo:104: 00010000:00010000:0.0:1788572087.790750:0:8504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.790802:0:8504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572087.790808:0:8504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:11665:x1875453518339328:12345-0@lo:104: Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572087.790814:0:8504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788572087.790848:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572087.790854:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.790861:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3600 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572087.790866:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.790883:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572087.790890:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572087.790895:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788572087.790920:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.790927:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572087.790946:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.790953:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c046db3600/0x977d9e7969bff6a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff6b0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.790965:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572087.790967:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572087.790969:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572087.790980:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518339456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572087.791017:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572087.791072:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518339456 00000100:00100000:0.0:1788572087.791076:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518339456 00010000:00010000:0.0:1788572087.791093:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff6a9 expref: 19 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572087.791114:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788572087.791121:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518339456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572087.791137:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572087.791143:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff6a9 expref: 19 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.791154:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff6a9 expref: 19 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.791170:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572087.791197:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518339456:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572087.791203:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788572087.791240:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518339456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572087.791383:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff69b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.791393:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff69b expref: 18 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572087.791411:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339584:0@lo:104: 00000100:00100000:3.0:1788572087.791436:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572087.791492:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969bff68d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.791500:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969bff68d expref: 18 pid: 5824 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572087.791508:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339712:0@lo:104: 00000100:00100000:3.0:1788572087.791532:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572087.791553:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df7 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.791563:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df7 expref: 12 pid: 5824 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572087.791653:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339840:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572087.792962:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788572087.792986:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518339584 00000100:00100000:0.0:1788572087.792993:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518339584 00000100:00100000:0.0:1788572087.794312:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518339712 00000100:00100000:0.0:1788572087.794322:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518339712 00000100:00100000:0.0:1788572087.794367:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572087.794377:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:11665:x1875453518339584:12345-0@lo:104: 00010000:00010000:0.0:1788572087.794393:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572087.794476:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572087.794482:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+4:11665:x1875453518339584:12345-0@lo:104: Request processed in 107us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572087.794488:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572087.794507:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788572087.794513:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bac7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:11665:x1875453518339712:12345-0@lo:104: 00010000:00010000:0.0:1788572087.794534:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572087.794936:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:3.0:1788572087.795946:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df0 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.795963:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df0 expref: 12 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572087.795977:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339968:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572087.796063:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bc5ff00 going to sleep for 11 seconds 00010000:00010000:3.0:1788572087.796091:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0ca00/0x977d9e7969bff6b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff6a9 expref: 18 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572087.796117:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339328:0@lo:104: 00000100:00100000:3.0:1788572087.796142:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339584:0@lo:104: 00000100:00100000:3.0:1788572087.796153:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339712:0@lo:104: 00000100:00100000:3.0:1788572087.796162:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339840:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572087.797550:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572087.797562:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797584:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90c00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572087.797588:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797599:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572087.797607:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572087.797612:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572087.797654:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797674:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572087.797705:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797713:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b90c00/0x977d9e7969bff69b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff6a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797725:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572087.797728:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797733:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572087.797736:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797742:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572087.797749:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572087.797754:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572087.797766:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797771:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572087.797784:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797790:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c046db3a00/0x977d9e7969bff68d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969bff694 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.797809:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572087.797810:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572087.797812:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572087.797827:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518340224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572087.797891:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572087.797946:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495235968 00000100:00100000:2.0:1788572087.797953:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495235968 00010000:00010000:2.0:1788572087.797980:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df7 expref: 13 pid: 5824 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572087.798004:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518340224 00000100:00100000:2.0:1788572087.798018:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518340224 00010000:00010000:2.0:1788572087.798031:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff68d expref: 18 pid: 5824 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572087.798202:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518340096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572087.798232:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572087.798301:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518340096 00000100:00100000:3.0:1788572087.798306:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518340096 00010000:00010000:3.0:1788572087.798321:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff69b expref: 19 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572087.798426:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1788572087.798438:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2355:x1875453495235968:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572087.798453:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572087.798459:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df7 expref: 13 pid: 5824 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.798470:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df7 expref: 13 pid: 5824 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.798485:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2800/0x977d9e7969bff686 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df7 expref: 13 pid: 5824 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572087.798499:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572087.798549:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+12:2355:x1875453495235968:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 113us (3616us total) trans 0 rc 0/0 00010000:00010000:0.0:1788572087.798813:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788572087.798823:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bac7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+3:11665:x1875453518339712:12345-0@lo:104: Request processed in 4308us (7288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572087.798831:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788572087.799002:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572087.801788:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788572087.801814:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058e7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518340224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572087.801835:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572087.801846:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff68d expref: 19 pid: 5824 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.801861:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff68d expref: 19 pid: 5824 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.801880:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3800/0x977d9e7969bff694 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff68d expref: 19 pid: 5824 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.801901:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572087.801990:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058e7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3297:x1875453518340224:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (4098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572087.802029:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788572087.802130:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788572087.802139:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3300:x1875453518340096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572087.802148:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572087.802153:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969bff69b expref: 17 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.802163:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969bff69b expref: 17 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.802173:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b90800/0x977d9e7969bff6a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969bff69b expref: 17 pid: 5825 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.802182:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572087.802299:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3300:x1875453518340096:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572087.802305:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788572087.802504:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518340224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572087.802600:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:1.0:1788572087.802609:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518340096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572087.803701:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572087.803767:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495236096 00000100:00100000:1.0:1788572087.803775:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495236096 00010000:00010000:1.0:1788572087.803804:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df0 expref: 12 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572087.803839:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:1.0:1788572087.803848:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+12:2356:x1875453495236096:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572087.803860:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572087.803876:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df0 expref: 12 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803886:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df0 expref: 12 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803906:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803916:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803934:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803942:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803949:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803957:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803963:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572087.803967:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803975:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.803984:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572087.804001:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572087.804068:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+12:2356:x1875453495236096:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 221us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572087.804075:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00010000:00010000:3.0:1788572087.805842:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff67f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10df0 expref: 11 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572087.805866:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875453518339968:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572087.805901:0:11665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.805911:0:11665:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.805931:0:11665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572087.805938:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041386800/0x977d9e7969bff7e4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572088.040635:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572088.424721:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518340480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572088.424796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572088.424873:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518340992:0@lo:400:kworker.0 00000100:00100000:1.0:1788572088.424898:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572088.424927:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572088.424933:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518340608:0@lo:400:kworker.0 00000100:00100000:1.0:1788572088.424956:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572088.425010:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518340480 00000100:00100000:1.0:1788572088.425018:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518340480 00000100:00100000:1.0:1788572088.425067:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518340608 00000100:00100000:1.0:1788572088.425070:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518340608 00000100:00100000:1.0:1788572088.425103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788572088.425114:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518340480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572088.425178:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518340480:12345-0@lo:400:kworker.0 Request processed in 65us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.425186:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788572088.425203:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1788572088.425460:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572088.425580:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518340352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572088.425628:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.425664:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518340864:0@lo:400:kworker.0 00000100:00100000:0.0:1788572088.425695:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.425714:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572088.425719:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518340736:0@lo:400:kworker.0 00000100:00100000:0.0:1788572088.425792:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.425869:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518340864 00000100:00100000:0.0:1788572088.425916:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518340864 00000100:00100000:0.0:1788572088.425995:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788572088.426004:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518340864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572088.426086:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518340864:12345-0@lo:400:kworker.0 Request processed in 83us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572088.426109:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788572088.426133:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518340992 00000100:00100000:0.0:1788572088.426137:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518340992 00000100:00100000:0.0:1788572088.426185:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518340736 00000100:00100000:0.0:1788572088.426203:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518340736 00000100:00100000:2.0:1788572088.426449:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518340352 00000100:00100000:2.0:1788572088.426454:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518340352 00000100:00100000:2.0:1788572088.426481:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788572088.426488:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3298:x1875453518340352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572088.426523:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3298:x1875453518340352:12345-0@lo:400:kworker.0 Request processed in 35us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572088.426528:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:2.0:1788572088.426576:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572088.426581:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572088.426626:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518340352:0@lo:400:kworker.0 00000100:00100000:2.0:1788572088.426640:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518340864:0@lo:400:kworker.0 00000100:00100000:2.0:1788572088.426687:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518340480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572088.427262:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572088.427277:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518340992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572088.427336:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518340992:12345-0@lo:400:kworker.0 Request processed in 65us (2436us total) trans 0 rc 0/0 00010000:00080000:2.0:1788572088.427394:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0765d1f80 x1875453518340992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572088.427406:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518340992:0@lo:400:kworker.0 00000100:00100000:2.0:1788572088.427451:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788572088.427461:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788572088.427674:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518340608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572088.427729:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518340608:12345-0@lo:400:kworker.0 Request processed in 2520us (2772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.427737:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788572088.427777:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518340608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572088.433638:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788572088.433668:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518340736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572088.433799:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518340736:12345-0@lo:400:kworker.0 Request processed in 148us (8005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572088.433809:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788572088.434282:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518340736:0@lo:400:kworker.0 00000100:00100000:0.0:1788572088.439885:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788572088.660474:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572088.660749:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495236224 00000100:00100000:0.0:1788572088.660759:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495236224 00000100:00100000:0.0:1788572088.660830:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 253 00000100:00100000:0.0:1788572088.660842:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+11:2356:x1875453495236224:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572088.660934:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+11:2356:x1875453495236224:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 94us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572088.660941:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 253 00000100:00100000:3.0:1788572088.661419:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572088.661460:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572088.661485:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572088.661557:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495236480 00000100:00100000:1.0:1788572088.661564:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495236480 00000100:00100000:1.0:1788572088.661619:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:1.0:1788572088.661627:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495236480:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572088.661669:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495236480:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 44us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.661676:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:2.0:1788572088.661862:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495236352 00000100:00100000:2.0:1788572088.661868:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495236352 00000100:00100000:2.0:1788572088.661910:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495236608 00000100:00100000:2.0:1788572088.661913:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495236608 00000100:00100000:2.0:1788572088.661934:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1788572088.661941:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495236352:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572088.661998:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495236352:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 58us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572088.662005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1788572088.662022:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00080000:3.0:1788572088.662024:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572088.662030:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495236608:12345-192.168.202.2@tcp:400:kworker.0 00000100:00080000:3.0:1788572088.662031:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572088.662057:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495236608:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 28us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572088.662064:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 10000000:01000000:1.0:1788572088.808840:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572088.808849:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c07bb14000 from 7 10000000:01000000:1.0:1788572088.808854:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572088.808912:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.808925:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.808936:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572088.808964:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572088.809066:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572088.809874:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474ff900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572088.822209:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518341120 00000100:00100000:2.0:1788572088.822224:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518341120 00000100:00100000:2.0:1788572088.822310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788572088.822673:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:5827:x1875453518341120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572088.822691:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572088.822721:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0d800/0x977d9e7969bff7f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff7eb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572088.822865:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0d800/0x977d9e7969bff7f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff7eb expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572088.822877:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0d800/0x977d9e7969bff7f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff7eb expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572088.822887:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d800, rc 0) 00000100:00100000:2.0:1788572088.823047:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518341120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 380us (13980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572088.823054:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788572088.826405:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572088.826436:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.826485:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572088.826864:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572088.827085:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572088.827133:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474ff900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572088.827233:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518341248 00000100:00100000:0.0:1788572088.827241:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518341248 00000100:00100000:0.0:1788572088.827334:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788572088.827344:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518341248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.827630:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518341248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572088.827637:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788572088.828420:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572088.828586:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572088.828646:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572088.829648:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474ff900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572088.834639:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518341376 00000100:00100000:3.0:1788572088.834656:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518341376 00000100:00100000:3.0:1788572088.835457:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788572088.836003:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518341376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572088.838610:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518341376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2897us (9952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572088.838625:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788572088.839682:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572088.843406:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11679:1875453518341504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572088.843677:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572088.844067:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518341504 00000100:00100000:3.0:1788572088.844077:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518341504 00000100:00100000:1.0:1788572088.844184:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0470480c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572088.845751:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788572088.845787:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:11679:x1875453518341504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572088.846119:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:11679:x1875453518341504:12345-0@lo:502:llog_process_th.0 Request processed in 339us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572088.846128:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788572088.846279:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11679:1875453518341504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572088.846315:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572088.846326:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572088.846328:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788572088.846335:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88c07bb14000 00000020:00000080:1.0:1788572088.846338:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788572088.846440:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11679:1875453518341632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572088.846487:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572088.862494:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0470480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572088.871823:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518341632 00000100:00100000:0.0:1788572088.871837:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518341632 00000100:00100000:0.0:1788572088.871893:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788572088.871904:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:11679:x1875453518341632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572088.872185:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:11679:x1875453518341632:12345-0@lo:502:llog_process_th.0 Request processed in 281us (25697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572088.872201:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788572088.872820:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11679:1875453518341632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572088.872862:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572088.872869:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572088.872872:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788572088.872877:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788572088.873898:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788572088.873931:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572088.873942:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572088.873953:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572088.873972:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788572088.873975:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c0503c8800 from 7 10000000:01000000:0.0:1788572088.873978:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788572088.874014:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572088.874023:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572088.874032:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572088.874055:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.874108:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.874156:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572088.874371:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518341760 00000100:00100000:1.0:1788572088.874378:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518341760 00000100:00100000:1.0:1788572088.874414:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788572088.874423:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:5827:x1875453518341760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572088.874436:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572088.874449:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2200/0x977d9e7969bff800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff7f9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.874485:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2200/0x977d9e7969bff800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff7f9 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.874497:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2200/0x977d9e7969bff800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff7f9 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.874505:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2200, rc 0) 00000100:00100000:1.0:1788572088.874554:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518341760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.874561:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788572088.875962:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572088.875996:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572088.876007:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572088.876084:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.876129:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.876174:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572088.876387:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518341888 00000100:00100000:1.0:1788572088.876393:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518341888 00000100:00100000:1.0:1788572088.876424:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788572088.876432:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518341888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572088.876682:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518341888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.876699:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788572088.882374:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518341888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.882438:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518342016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.882643:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.882683:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788572088.883378:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518342016 00000100:00100000:1.0:1788572088.883388:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518342016 00000100:00100000:1.0:1788572088.883430:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788572088.883439:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518342016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572088.884357:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518342016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 913us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.884367:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788572088.884853:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518342016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.886137:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11682:1875453518342144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572088.887000:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572088.887299:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518342144 00000100:00100000:1.0:1788572088.887308:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518342144 00000100:00100000:1.0:1788572088.887362:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788572088.887371:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:11682:x1875453518342144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572088.888313:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788572088.891417:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:11682:x1875453518342144:12345-0@lo:502:llog_process_th.0 Request processed in 4037us (4409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.891433:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788572088.893138:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11682:1875453518342144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572088.893187:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788572088.894020:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572088.894023:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788572088.894032:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88c0503c8800 00000020:00000080:2.0:1788572088.894034:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788572088.894136:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11682:1875453518342272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572088.897546:0:11682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572088.897601:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788572088.898216:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518342272 00000100:00100000:0.0:1788572088.898228:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518342272 00000100:00100000:0.0:1788572088.898315:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788572088.898327:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:11682:x1875453518342272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572088.898620:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:11682:x1875453518342272:12345-0@lo:502:llog_process_th.0 Request processed in 296us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572088.898628:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788572088.898977:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11682:1875453518342272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572088.899015:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572088.899024:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572088.899026:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788572088.899032:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:2.0:1788572088.901349:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:0.0:1788572088.903687:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788572088.903737:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572088.903749:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572088.903765:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572088.903790:0:5827:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788572088.903793:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c065ad2800 from 7 10000000:01000000:0.0:1788572088.903810:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788572088.903851:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572088.903860:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572088.903872:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572088.903901:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518342400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.903981:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.904027:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572088.904521:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518342400 00000100:00100000:1.0:1788572088.904531:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518342400 00000100:00100000:1.0:1788572088.904583:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788572088.904593:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:5827:x1875453518342400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572088.904606:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572088.904620:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db2800/0x977d9e7969bff80e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969bff807 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.904653:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db2800/0x977d9e7969bff80e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969bff807 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.904664:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db2800/0x977d9e7969bff80e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969bff807 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.904674:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2800, rc 0) 00000100:00100000:1.0:1788572088.904742:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518342400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.904748:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788572088.906298:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518342400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572088.906323:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572088.906335:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572088.906411:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518342528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572088.906473:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572088.906505:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bc5fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572088.906784:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518342528 00000100:00100000:2.0:1788572088.906790:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518342528 00000100:00100000:2.0:1788572088.907023:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788572088.907034:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518342528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572088.911612:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518342528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4570us (5128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572088.911625:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788572088.930748:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518342528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.930835:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518342656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.930925:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572088.931080:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518342656 00000100:00100000:1.0:1788572088.931087:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518342656 00000100:00100000:1.0:1788572088.931140:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788572088.931149:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518342656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572088.931365:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:5827:x1875453518342656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.931374:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788572088.942569:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572088.942614:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07b09b9b-dc48-4957-bfb2-5dac95d9db69:5827:1875453518342656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572088.942870:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518342784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572088.942942:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.943739:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11685:1875453518342912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572088.943791:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.943831:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572088.943943:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518342912 00000100:00100000:1.0:1788572088.943950:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518342912 00000100:00100000:1.0:1788572088.944011:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788572088.944021:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:11685:x1875453518342912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572088.944268:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:11685:x1875453518342912:12345-0@lo:502:llog_process_th.0 Request processed in 227us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.944278:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788572088.946618:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11685:1875453518342912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788572088.946663:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572088.946672:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572088.946675:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788572088.946682:0:11685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88c065ad2800 00000020:00000080:0.0:1788572088.946685:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788572088.946804:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11685:1875453518343040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572088.946873:0:11685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572088.946913:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572088.947225:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518343040 00000100:00100000:1.0:1788572088.947233:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518343040 00000100:00100000:1.0:1788572088.947318:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788572088.947327:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:11685:x1875453518343040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572088.947556:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:11685:x1875453518343040:12345-0@lo:502:llog_process_th.0 Request processed in 230us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572088.947564:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788572088.948360:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07b09b9b-dc48-4957-bfb2-5dac95d9db69:11685:1875453518343040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788572088.948400:0:11685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572088.948407:0:11685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572088.948410:0:11685:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788572088.948414:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788572088.948673:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788572088.948699:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788572088.948719:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572088.948730:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572088.949408:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518342784 00000100:00100000:0.0:1788572088.949416:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518342784 00000100:00100000:0.0:1788572088.949536:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788572088.949547:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518342784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572088.949580:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572088.949651:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518342784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (6709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572088.949658:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788572088.949782:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf46a67100 x1875453518342784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572088.949810:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518342784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572089.064438:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572089.237571:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572089.238407:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495236736 00000100:00100000:1.0:1788572089.238418:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495236736 00000100:00100000:1.0:1788572089.238544:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 269 00000100:00100000:1.0:1788572089.238556:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+11:5597:x1875453495236736:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572089.238573:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572089.238591:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff815 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e44 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572089.238624:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e44 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572089.238637:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e44 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572089.238650:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db3a00, rc 0) 00000100:00100000:1.0:1788572089.241019:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495236736:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 2131us (3124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572089.241036:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 269 00000100:00100000:3.0:1788572089.254494:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572089.254614:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495236864 00000100:00100000:0.0:1788572089.254625:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495236864 00000100:00100000:0.0:1788572089.254693:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 270 00000100:00100000:0.0:1788572089.254705:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495236864:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572089.255024:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495236864:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 321us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572089.255031:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 270 00000100:00100000:3.0:1788572089.266750:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572089.266969:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495236992 00000100:00100000:1.0:1788572089.266979:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495236992 00000100:00100000:1.0:1788572089.267163:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 271 00000100:00100000:1.0:1788572089.267184:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495236992:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572089.267492:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495236992:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 319us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572089.267501:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 271 00000100:00100000:1.0:1788572089.274122:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572089.274287:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495237120 00000100:00100000:2.0:1788572089.274296:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495237120 00000100:00100000:2.0:1788572089.274357:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 272 00000100:00100000:2.0:1788572089.274367:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+12:9986:x1875453495237120:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788572089.274609:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+12:9986:x1875453495237120:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 243us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572089.274617:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 272 00000100:00100000:3.0:1788572089.283882:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572089.284290:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495237248 00000100:00100000:1.0:1788572089.284302:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495237248 00000100:00100000:1.0:1788572089.284437:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 273 00000100:00100000:1.0:1788572089.284448:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:9986:x1875453495237248:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788572089.288848:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:9986:x1875453495237248:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 4389us (4963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572089.288865:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 273 00000100:00100000:3.0:1788572089.318972:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572089.320207:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495237376 00000100:00100000:0.0:1788572089.320222:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495237376 00000100:00100000:0.0:1788572089.320337:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 274 00000100:00100000:0.0:1788572089.320348:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+12:5597:x1875453495237376:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572089.320367:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572089.320386:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff81c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e4b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572089.320414:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e4b expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572089.320425:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff81c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e4b expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572089.320435:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90c00, rc 0) 00000100:00100000:0.0:1788572089.320521:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495237376:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 174us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572089.320528:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 274 00000100:00100000:0.0:1788572089.326368:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572089.326480:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495237504 00000100:00100000:1.0:1788572089.326492:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495237504 00000100:00100000:1.0:1788572089.326563:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 275 00000100:00100000:1.0:1788572089.326574:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495237504:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572089.326888:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495237504:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 315us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572089.326896:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 275 00000100:00100000:3.0:1788572089.338413:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572089.338589:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495237632 00000100:00100000:2.0:1788572089.338600:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495237632 00000100:00100000:2.0:1788572089.338778:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 276 00000100:00100000:2.0:1788572089.338789:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495237632:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572089.339042:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:5597:x1875453495237632:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 254us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572089.339050:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 276 00000100:00100000:3.0:1788572089.342624:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572089.342926:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495237760 00000100:00100000:0.0:1788572089.342967:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495237760 00000100:00100000:0.0:1788572089.343036:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 277 00000100:00100000:0.0:1788572089.343048:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:9989:x1875453495237760:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788572089.343517:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:9989:x1875453495237760:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 469us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572089.343526:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 277 00000100:00100000:0.0:1788572089.350520:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572089.350708:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495237888 00000100:00100000:2.0:1788572089.350718:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495237888 00000100:00100000:2.0:1788572089.350771:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 278 00000100:00100000:2.0:1788572089.350780:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:9989:x1875453495237888:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788572089.351081:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:9989:x1875453495237888:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 300us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572089.351090:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 278 00000100:00100000:0.0:1788572089.449379:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518343168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572089.449463:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572089.449691:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518343168 00000100:00100000:1.0:1788572089.449700:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518343168 00000100:00100000:1.0:1788572089.449772:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788572089.449784:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518343168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572089.449830:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788572089.449897:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572089.452299:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518343168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2509us (2827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572089.452313:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788572089.452492:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518343168:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788572089.961781:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788572090.089505:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572091.112789:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788572092.073881:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1788572092.136447:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572093.160573:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572093.548432:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518343424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.548501:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572093.548567:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518343936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.548592:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572093.548621:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572093.548626:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518343552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.548647:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572093.548682:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518343424 00000100:00100000:0.0:1788572093.548689:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518343424 00000100:00100000:0.0:1788572093.548730:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518343552 00000100:00100000:0.0:1788572093.548734:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518343552 00000100:00100000:0.0:1788572093.548763:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788572093.548772:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518343424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.548832:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518343424:12345-0@lo:400:kworker.0 Request processed in 61us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572093.548854:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788572093.548872:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788572093.548879:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518343552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.548906:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518343552:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572093.548911:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788572093.548928:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518343936 00000100:00100000:0.0:1788572093.548931:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518343936 00000100:00100000:0.0:1788572093.548953:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788572093.548959:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518343936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.548986:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518343936:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572093.549002:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788572093.549020:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572093.549025:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572093.549058:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518343552:0@lo:400:kworker.0 00000100:00100000:2.0:1788572093.549059:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518343296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.549073:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518343424:0@lo:400:kworker.0 00010000:00080000:0.0:1788572093.549086:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf46a67b80 x1875453518343936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572093.549096:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518343936:0@lo:400:kworker.0 00000100:00100000:2.0:1788572093.549108:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572093.549140:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518343296 00000100:00100000:0.0:1788572093.549144:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518343296 00000100:00100000:2.0:1788572093.549149:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518343808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.549178:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788572093.549179:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572093.549190:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518343296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572093.549204:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572093.549213:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518343680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.549238:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518343296:12345-0@lo:400:kworker.0 Request processed in 50us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572093.549271:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572093.549280:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788572093.549300:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518343296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.549315:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518343808 00000100:00100000:0.0:1788572093.549320:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518343808 00000100:00100000:2.0:1788572093.549330:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518343680 00000100:00100000:2.0:1788572093.549335:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518343680 00000100:00100000:0.0:1788572093.549349:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788572093.549357:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518343808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572093.549380:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788572093.549390:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518343680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.549398:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518343808:12345-0@lo:400:kworker.0 Request processed in 41us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572093.549406:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788572093.549425:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572093.549430:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572093.549432:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518343680:12345-0@lo:400:kworker.0 Request processed in 43us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572093.549439:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788572093.549449:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788572093.549456:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c076235180, transno 4294967300 00000100:00100000:0.0:1788572093.549470:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518343680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572093.549482:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518343808:0@lo:400:kworker.0 00000100:00100000:3.0:1788572093.783492:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572093.783519:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572093.783549:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572093.783564:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495238144 00000100:00100000:0.0:1788572093.783576:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495238144 00000100:00100000:3.0:1788572093.783597:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00080000:3.0:1788572093.783643:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572093.783644:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495238400 00000100:00100000:0.0:1788572093.783649:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495238400 00000100:00100000:0.0:1788572093.783678:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00080000:3.0:1788572093.783682:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572093.783689:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495238144:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572093.783800:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495238144:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572093.783808:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:0.0:1788572093.783826:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:0.0:1788572093.783839:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2355:x1875453495238400:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572093.783864:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2355:x1875453495238400:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572093.783870:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:2.0:1788572093.784006:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495238016 00000100:00100000:2.0:1788572093.784012:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495238016 00000100:00100000:2.0:1788572093.784117:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 280 00000100:00100000:2.0:1788572093.784126:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2355:x1875453495238016:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572093.784158:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2355:x1875453495238016:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 33us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572093.784164:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 280 00000100:00100000:0.0:1788572093.784209:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495238272 00000100:00100000:0.0:1788572093.784215:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495238272 00000100:00080000:2.0:1788572093.784245:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572093.784288:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1788572093.784297:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495238272:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572093.784324:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495238272:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 29us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572093.784330:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1788572094.056664:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572094.056689:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518344064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572094.056773:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572094.056864:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518344064 00000100:00100000:0.0:1788572094.056873:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518344064 00000100:00100000:0.0:1788572094.056943:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788572094.056953:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518344064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572094.057022:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572094.057077:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518344064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572094.057089:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788572094.057277:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c35df80 x1875453518344064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572094.057297:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518344064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572094.184483:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572094.569018:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518344192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572094.569091:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572094.569194:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518344192 00000100:00100000:0.0:1788572094.569203:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518344192 00000100:00100000:0.0:1788572094.569275:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788572094.569297:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518344192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572094.569332:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572094.569381:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518344192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572094.569387:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788572094.569651:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518344192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572095.208459:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572096.233057:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572097.260310:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572098.280745:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572098.666053:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518344448:0@lo:400:kworker.0 00000100:00100000:1.0:1788572098.666119:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572098.666185:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518344960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572098.666480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572098.666516:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572098.666523:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518344576:0@lo:400:kworker.0 00000100:00100000:1.0:1788572098.666544:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572098.666595:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518344448 00000100:00100000:1.0:1788572098.666610:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518344448 00000100:00100000:1.0:1788572098.666659:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518344576 00000100:00100000:1.0:1788572098.666662:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518344576 00000100:00100000:1.0:1788572098.666695:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788572098.666702:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518344448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572098.666773:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518344448:12345-0@lo:400:kworker.0 Request processed in 70us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572098.666782:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788572098.666804:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788572098.666811:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518344576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572098.666840:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518344576:12345-0@lo:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572098.666857:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788572098.666881:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518344960 00000100:00100000:1.0:1788572098.666885:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518344960 00000100:00100000:1.0:1788572098.666915:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788572098.666921:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518344960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572098.667425:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518344704:0@lo:400:kworker.0 00000100:00100000:3.0:1788572098.667463:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572098.667493:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572098.667500:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518344320:0@lo:400:kworker.0 00000100:00100000:3.0:1788572098.667528:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572098.667556:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518344832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572098.667566:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518344320 00000100:00100000:2.0:1788572098.667571:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518344320 00000100:00100000:3.0:1788572098.667590:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572098.667616:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788572098.667622:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518344320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572098.667661:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518344320:12345-0@lo:400:kworker.0 Request processed in 40us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572098.667668:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788572098.667698:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518344704 00000100:00100000:2.0:1788572098.667701:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518344704 00000100:00100000:2.0:1788572098.667736:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788572098.667742:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518344704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572098.667750:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518344320:0@lo:400:kworker.0 00000100:00100000:2.0:1788572098.667770:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518344704:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572098.667772:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518344704:0@lo:400:kworker.0 00000100:00100000:2.0:1788572098.667788:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788572098.667816:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518344832 00000100:00100000:2.0:1788572098.667820:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518344832 00000100:00100000:2.0:1788572098.667838:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788572098.668004:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518344832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572098.668040:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518344832:12345-0@lo:400:kworker.0 Request processed in 196us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572098.668046:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788572098.668076:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518344832:0@lo:400:kworker.0 00000100:00080000:2.0:1788572098.668106:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572098.668109:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572098.668112:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572098.668128:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518344576:0@lo:400:kworker.0 00000100:00100000:3.0:1788572098.668141:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518344448:0@lo:400:kworker.0 00010000:00080000:3.0:1788572098.670366:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c04754d500 x1875453518344960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572098.670386:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518344960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572098.672001:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518344960:12345-0@lo:400:kworker.0 Request processed in 3229us (3670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572098.672026:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788572098.906855:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572098.906899:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572098.907026:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495238784 00000100:00100000:0.0:1788572098.907036:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495238784 00000100:00100000:0.0:1788572098.907119:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:0.0:1788572098.907130:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495238784:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572098.907212:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495238784:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572098.907219:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00080000:1.0:1788572098.907371:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572098.907451:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572098.907486:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572098.907507:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495238656 00000100:00100000:3.0:1788572098.907511:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495238656 00000100:00100000:3.0:1788572098.907541:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495238912 00000100:00100000:3.0:1788572098.907544:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495238912 00000100:00100000:3.0:1788572098.907562:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:3.0:1788572098.907602:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495238656:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572098.907649:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495238656:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 49us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572098.907655:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:3.0:1788572098.907669:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:3.0:1788572098.907674:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495238912:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572098.907693:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495238912:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 20us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572098.907699:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00080000:1.0:1788572098.907757:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572098.908291:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495238528 00000100:00100000:2.0:1788572098.908297:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495238528 00000100:00100000:2.0:1788572098.908326:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 282 00000100:00100000:2.0:1788572098.908333:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2354:x1875453495238528:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572098.908370:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2354:x1875453495238528:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 38us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572098.908377:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 282 00000040:00080000:3.0:1788572099.177001:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788572099.177810:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518345088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572099.177888:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572099.178140:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518345088 00000100:00100000:0.0:1788572099.178148:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518345088 00000100:00100000:0.0:1788572099.178199:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788572099.178208:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518345088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572099.178243:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572099.178329:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518345088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572099.178336:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788572099.178420:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c35d180 x1875453518345088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572099.178439:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518345088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572099.304968:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572099.694565:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572099.694592:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518345216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572099.694684:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572099.695019:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518345216 00000100:00100000:2.0:1788572099.695028:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518345216 00000100:00100000:2.0:1788572099.695087:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788572099.695097:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518345216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572099.695138:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572099.695189:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518345216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572099.695196:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788572099.695242:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518345216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572100.328424:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572101.356915:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572102.378409:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572103.400399:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572103.784596:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c05076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518345600:0@lo:400:kworker.0 00000100:00100000:1.0:1788572103.784669:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572103.784732:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788572103.784738:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518345472:0@lo:400:kworker.0 00000100:00100000:1.0:1788572103.784757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572103.784775:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518345984:0@lo:400:kworker.0 00000100:00100000:1.0:1788572103.784795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572103.784822:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518345600 00000100:00100000:1.0:1788572103.784830:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518345600 00000100:00100000:1.0:1788572103.784877:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518345472 00000100:00100000:1.0:1788572103.784880:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518345472 00000100:00100000:1.0:1788572103.784899:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788572103.784908:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518345600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572103.784918:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788572103.784932:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518345472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572103.784956:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518345600:12345-0@lo:400:kworker.0 Request processed in 48us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572103.784963:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788572103.784981:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518345472:12345-0@lo:400:kworker.0 Request processed in 53us (220us total) trans 0 rc 0/0 00000100:00080000:1.0:1788572103.784988:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572103.784990:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788572103.785021:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518345984 00000100:00100000:1.0:1788572103.785022:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518345472:0@lo:400:kworker.0 00000100:00100000:3.0:1788572103.785025:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518345984 00000100:00100000:1.0:1788572103.785036:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c05076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518345600:0@lo:400:kworker.0 00000100:00100000:3.0:1788572103.785074:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788572103.785084:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518345984:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788572103.785102:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572103.785123:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518345984:12345-0@lo:400:kworker.0 Request processed in 40us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572103.785130:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788572103.785136:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c050769180 x1875453518345984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572103.785147:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518345984:0@lo:400:kworker.0 00000100:00100000:2.0:1788572103.785212:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c05076bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518345344:0@lo:400:kworker.0 00000100:00100000:2.0:1788572103.785295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572103.785327:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518345856:0@lo:400:kworker.0 00000100:00100000:2.0:1788572103.785351:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572103.785369:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572103.785377:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518345728:0@lo:400:kworker.0 00000100:00100000:2.0:1788572103.785414:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572103.785415:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518345856 00000100:00100000:0.0:1788572103.785421:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518345856 00000100:00100000:2.0:1788572103.785453:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518345728 00000100:00100000:2.0:1788572103.785459:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518345728 00000100:00100000:0.0:1788572103.785465:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788572103.785476:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518345856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572103.785494:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788572103.785503:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518345728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572103.785531:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518345856:12345-0@lo:400:kworker.0 Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572103.785551:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1788572103.785572:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572103.785576:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572103.785627:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518345344 00000100:00100000:3.0:1788572103.785642:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518345344 00000100:00100000:3.0:1788572103.785671:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788572103.785678:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0474a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518345344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572103.788522:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518345728:12345-0@lo:400:kworker.0 Request processed in 3010us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572103.788537:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788572103.793734:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518345856:0@lo:400:kworker.0 00000100:00100000:0.0:1788572103.793777:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518345728:0@lo:400:kworker.0 00000100:00100000:3.0:1788572103.796893:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0474a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518345344:12345-0@lo:400:kworker.0 Request processed in 11205us (11587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572103.796908:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788572103.797446:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c05076bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518345344:0@lo:400:kworker.0 00000100:00100000:3.0:1788572104.026944:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572104.026986:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572104.027245:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495239168 00000100:00100000:1.0:1788572104.027282:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495239168 00000100:00100000:1.0:1788572104.027361:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:1.0:1788572104.027371:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495239168:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572104.027469:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495239168:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 99us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572104.027477:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00080000:3.0:1788572104.028000:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572104.028080:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495239040 00000100:00100000:0.0:1788572104.028086:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495239040 00000100:00100000:0.0:1788572104.028126:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 284 00000100:00100000:0.0:1788572104.028136:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495239040:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572104.028180:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495239040:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 47us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572104.028187:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 284 00000100:00100000:3.0:1788572104.046524:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572104.046577:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572104.046642:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495239296 00000100:00100000:1.0:1788572104.046653:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495239296 00000100:00100000:1.0:1788572104.046737:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1788572104.046747:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2352:x1875453495239296:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:1.0:1788572104.046777:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff758 00000100:00080000:1.0:1788572104.046785:0:6680:0:(import.c:65:import_set_state_nolock()) ffff88c07c3e7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572104.046817:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788572104.047077:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+2:2352:x1875453495239296:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 330us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572104.047084:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00010000:00010000:3.0:1788572104.047389:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572104.047408:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572104.047493:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495239424 00000100:00100000:0.0:1788572104.047498:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495239424 00000100:00100000:0.0:1788572104.047558:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:0.0:1788572104.047565:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495239424:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572104.047613:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495239424:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 49us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572104.047620:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00080000:3.0:1788572104.048084:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572104.296843:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518346112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572104.296915:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572104.297081:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518346112 00000100:00100000:0.0:1788572104.297090:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518346112 00000100:00100000:0.0:1788572104.297139:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788572104.297162:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518346112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572104.297199:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572104.297284:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518346112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572104.297291:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788572104.297373:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c35ea00 x1875453518346112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572104.297402:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518346112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572104.424703:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572104.808803:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518346240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572104.808890:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572104.809132:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518346240 00000100:00100000:0.0:1788572104.809141:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518346240 00000100:00100000:0.0:1788572104.809191:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788572104.809202:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518346240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572104.809235:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572104.809760:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518346240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 559us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572104.809769:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788572104.810200:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518346240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572105.448767:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572106.472597:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788572107.429953:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:1.0:1788572107.429963:0:6703:0:(genops.c:885:class_export_put()) final put ffff88c07c3e2000/78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:3.0:1788572107.430138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c3e2000/78708c10-ef63-4de2-8b1c-aff484c98227 for lustre-OST0000 00000020:00000080:3.0:1788572107.430190:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c07c3e7000 for lustre-OST0000 00010000:00010000:1.0:1788572107.497820:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572108.522695:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572108.913233:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518346496:0@lo:400:kworker.0 00000100:00100000:0.0:1788572108.913340:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572108.913402:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518347008:0@lo:400:kworker.0 00000100:00100000:0.0:1788572108.913429:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572108.913457:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572108.913463:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518346624:0@lo:400:kworker.0 00000100:00100000:0.0:1788572108.913501:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572108.913649:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518346752:0@lo:400:kworker.0 00000100:00100000:2.0:1788572108.913681:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572108.913727:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788572108.913734:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518346368:0@lo:400:kworker.0 00000100:00100000:2.0:1788572108.913775:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572108.913813:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518346880:0@lo:400:kworker.0 00000100:00100000:2.0:1788572108.913836:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572108.913875:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518346368 00000100:00100000:2.0:1788572108.913882:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518346368 00000100:00100000:2.0:1788572108.913924:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788572108.913932:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518346368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572108.913979:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518346368:12345-0@lo:400:kworker.0 Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572108.913986:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788572108.914032:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518346368:0@lo:400:kworker.0 00000100:00100000:1.0:1788572108.917047:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518346496 00000100:00100000:1.0:1788572108.917064:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518346496 00000100:00100000:1.0:1788572108.917126:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518346624 00000100:00100000:1.0:1788572108.917145:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518346624 00000100:00100000:1.0:1788572108.917174:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518346880 00000100:00100000:1.0:1788572108.917177:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518346880 00000100:00100000:1.0:1788572108.917197:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788572108.917206:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518346496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572108.917326:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518346496:12345-0@lo:400:kworker.0 Request processed in 120us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572108.917333:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788572108.917350:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788572108.917356:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518346624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572108.917385:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518346624:12345-0@lo:400:kworker.0 Request processed in 30us (3884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572108.917390:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788572108.917401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788572108.917407:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518346880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572108.917440:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518346880:12345-0@lo:400:kworker.0 Request processed in 33us (3602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572108.917446:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788572108.917465:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518347008 00000100:00100000:1.0:1788572108.917469:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518347008 00000100:00100000:1.0:1788572108.917704:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518346752 00000100:00100000:1.0:1788572108.917708:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518346752 00000100:00100000:1.0:1788572108.917732:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788572108.917738:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518347008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572108.917774:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518347008:12345-0@lo:400:kworker.0 Request processed in 35us (4344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572108.917780:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788572108.917813:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788572108.917820:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518346752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572108.918940:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518346752:12345-0@lo:400:kworker.0 Request processed in 1113us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572108.918952:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788572108.918997:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572108.919002:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572108.919006:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572108.919051:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518346624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572108.919067:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518346496:0@lo:400:kworker.0 00010000:00080000:1.0:1788572108.919080:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c07c35df80 x1875453518347008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572108.919102:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518347008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572108.919148:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518346880:0@lo:400:kworker.0 00000100:00100000:1.0:1788572108.919159:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518346752:0@lo:400:kworker.0 00000100:00100000:0.0:1788572109.142730:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572109.142775:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572109.142801:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572109.142830:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495239680 00000100:00100000:0.0:1788572109.142867:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495239680 00000100:00100000:0.0:1788572109.142921:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495239808 00000100:00100000:0.0:1788572109.142925:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495239808 00000100:00100000:0.0:1788572109.142951:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:0.0:1788572109.142962:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495239680:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572109.143051:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495239680:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 92us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572109.143059:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:0.0:1788572109.143082:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:0.0:1788572109.143089:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495239808:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572109.143115:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495239808:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572109.143122:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:0.0:1788572109.143142:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495239552 00000100:00100000:0.0:1788572109.143146:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495239552 00000100:00100000:0.0:1788572109.143174:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 286 00000100:00100000:0.0:1788572109.143181:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495239552:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572109.143207:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495239552:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572109.143214:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 286 00000100:00080000:0.0:1788572109.143241:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572109.416943:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518347136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572109.417019:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572109.417133:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518347136 00000100:00100000:0.0:1788572109.417141:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518347136 00000100:00100000:0.0:1788572109.417196:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788572109.417206:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518347136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572109.417240:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572109.417355:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518347136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572109.417363:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788572109.417668:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf46a66a00 x1875453518347136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572109.417692:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518347136:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788572109.418343:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788572109.545386:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572109.930467:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c05076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518347264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572109.930538:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572109.932114:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518347264 00000100:00100000:1.0:1788572109.932126:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518347264 00000100:00100000:1.0:1788572109.932220:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788572109.932242:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518347264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572109.932297:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572109.932366:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518347264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572109.932386:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788572109.935446:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c05076b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518347264:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572110.568680:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572111.592415:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572112.617345:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572112.835136:0:11846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:35:11 (1788572111) 00010000:00010000:1.0:1788572113.647213:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572114.024576:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572114.024601:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518347776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572114.024613:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518347648:0@lo:400:kworker.0 00000100:00100000:3.0:1788572114.024690:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518347520:0@lo:400:kworker.0 00000100:00100000:1.0:1788572114.024727:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518347904:0@lo:400:kworker.0 00000100:00100000:2.0:1788572114.026787:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572114.026868:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518347392:0@lo:400:kworker.0 00000100:00100000:2.0:1788572114.026911:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572114.026982:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518347392 00000100:00100000:2.0:1788572114.026989:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518347392 00000100:00100000:2.0:1788572114.027036:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788572114.027046:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518347392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572114.027097:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518347392:12345-0@lo:400:kworker.0 Request processed in 53us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572114.027131:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788572114.027196:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518347392:0@lo:400:kworker.0 00000100:00100000:0.0:1788572114.029654:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572114.029900:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518347648 00000100:00100000:2.0:1788572114.029909:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518347648 00000100:00100000:3.0:1788572114.029911:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572114.029942:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518348032:0@lo:400:kworker.0 00000100:00100000:2.0:1788572114.029975:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518347520 00000100:00100000:2.0:1788572114.029979:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518347520 00000100:00100000:3.0:1788572114.029992:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572114.030009:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788572114.030020:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518347648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572114.030031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788572114.030041:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518347520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572114.030084:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518347648:12345-0@lo:400:kworker.0 Request processed in 65us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572114.030091:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788572114.030201:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518347776 00000100:00100000:0.0:1788572114.030206:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518347776 00000100:00100000:3.0:1788572114.030212:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518347520:12345-0@lo:400:kworker.0 Request processed in 172us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572114.030348:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788572114.030369:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518348032 00000100:00100000:3.0:1788572114.030373:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518348032 00000100:00100000:0.0:1788572114.030891:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788572114.030900:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518347776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572114.031711:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518347776:12345-0@lo:400:kworker.0 Request processed in 808us (4927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.031720:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788572114.033577:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518347776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572114.033634:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518347648:0@lo:400:kworker.0 00000100:00100000:0.0:1788572114.033686:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518347520:0@lo:400:kworker.0 00000100:00100000:1.0:1788572114.034338:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572114.034654:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572114.034660:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572114.034665:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572114.035207:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518347904 00000100:00100000:0.0:1788572114.035218:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518347904 00000100:00100000:0.0:1788572114.035327:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788572114.035340:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518347904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572114.035412:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518347904:12345-0@lo:400:kworker.0 Request processed in 75us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.035419:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1788572114.035492:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572114.036681:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518347904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572114.036690:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788572114.036703:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518348032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572114.036959:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518348032:12345-0@lo:400:kworker.0 Request processed in 259us (6965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572114.036967:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788572114.037765:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764a6d80 x1875453518348032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572114.037807:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518348032:0@lo:400:kworker.0 00000100:00100000:1.0:1788572114.263882:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572114.263939:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572114.264034:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495239936 00000100:00100000:0.0:1788572114.264045:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495239936 00000100:00100000:0.0:1788572114.264119:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 288 00000100:00100000:0.0:1788572114.264140:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495239936:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572114.264240:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495239936:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 110us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.264277:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 288 00000100:00100000:2.0:1788572114.264773:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495240064 00000100:00100000:2.0:1788572114.264779:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495240064 00000100:00100000:2.0:1788572114.264853:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:2.0:1788572114.264878:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495240064:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572114.264941:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495240064:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 63us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572114.264947:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00080000:1.0:1788572114.265738:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572114.268933:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572114.269554:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495240192 00000100:00100000:0.0:1788572114.269566:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495240192 00000100:00100000:0.0:1788572114.269653:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:0.0:1788572114.269664:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495240192:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572114.269751:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495240192:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 89us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.269760:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00080000:1.0:1788572114.272692:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572114.541037:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572114.541069:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518348160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572114.541192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572114.541441:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518348160 00000100:00100000:0.0:1788572114.541452:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518348160 00000100:00100000:0.0:1788572114.541518:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572114.541529:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518348160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572114.541566:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572114.541629:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518348160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.541637:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788572114.542115:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88c0764a6d80 x1875453518348160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572114.542148:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518348160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572114.664882:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572114.824599:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572114.824709:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495240320 00000100:00100000:0.0:1788572114.824733:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495240320 00000100:00100000:0.0:1788572114.824802:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:0.0:1788572114.824814:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:10258:x1875453495240320:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572114.824833:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572114.824861:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969bff823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.824929:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff82a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.824943:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff82a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.824957:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff82a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572114.824991:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788572114.824995:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572114.825051:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff82a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.825078:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969bff823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e52 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.825143:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff82a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e52 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.825152:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0481bf900) 00010000:00010000:0.0:1788572114.825155:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572114.825158:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90e00, rc 0) 00000100:00100000:0.0:1788572114.825236:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:10258:x1875453495240320:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 424us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.825244:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:2.0:1788572114.838388:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572114.838765:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495240448 00000100:00100000:0.0:1788572114.838778:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495240448 00000100:00100000:0.0:1788572114.838843:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:0.0:1788572114.838855:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:10259:x1875453495240448:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572114.838877:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572114.838899:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969bff831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839285:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839302:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839325:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839343:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839350:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839356:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839799:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff846 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839818:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff846 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839827:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff846 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572114.839858:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788572114.839862:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572114.839882:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff846 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839895:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839902:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839911:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.839917:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572114.839921:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840200:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840214:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0481bf900) 00010000:00010000:0.0:1788572114.840217:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572114.840222:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840241:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91800/0x977d9e7969bff838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840294:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840301:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840306:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840311:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572114.840314:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840386:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840395:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88c0481bf000) 00010000:00010000:0.0:1788572114.840398:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572114.840401:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840406:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90600/0x977d9e7969bff83f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840648:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90800/0x977d9e7969bff831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e59 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840663:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff846 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e59 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.840679:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:0.0:1788572114.840681:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572114.840684:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076b90400, rc 0) 00000100:00100000:0.0:1788572114.840825:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:10259:x1875453495240448:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1972us (2447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572114.840833:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:1.0:1788572114.848375:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572114.848484:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495240704 00000100:00100000:0.0:1788572114.848494:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495240704 00000100:00100000:0.0:1788572114.848547:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:0.0:1788572114.848558:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:10259:x1875453495240704:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572114.848577:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572114.848599:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969bff84d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e60 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.848673:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.848687:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.848697:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.848755:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.848764:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.848790:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849207:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969bff862 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849217:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969bff862 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849224:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969bff862 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572114.849235:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788572114.849460:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849469:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849476:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849482:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572114.849487:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849496:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849510:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:0.0:1788572114.849513:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572114.849526:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849532:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91000/0x977d9e7969bff854 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849551:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849558:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849563:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849568:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572114.849571:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849577:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849586:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88c0481bf500) 00010000:00010000:0.0:1788572114.849588:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572114.849591:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.849597:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90000/0x977d9e7969bff85b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.850107:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b91200/0x977d9e7969bff84d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e60 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.850141:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969bff862 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e60 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572114.850150:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:0.0:1788572114.850153:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572114.850155:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a000, rc 0) 00000100:00100000:0.0:1788572114.850230:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+9:10259:x1875453495240704:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1674us (1866us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788572114.850240:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:2.0:1788572114.885229:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572114.885548:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495240832 00000100:00100000:3.0:1788572114.885559:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495240832 00000100:00100000:3.0:1788572114.885626:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:3.0:1788572114.885638:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:10259:x1875453495240832:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788572114.886492:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:10259:x1875453495240832:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 851us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572114.886520:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:3.0:1788572115.049435:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518348288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572115.049506:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572115.049865:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518348288 00000100:00100000:0.0:1788572115.049876:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518348288 00000100:00100000:0.0:1788572115.049941:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788572115.049951:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518348288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572115.049985:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572115.050034:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518348288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572115.050040:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788572115.050159:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518348288:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788572115.563674:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788572115.689497:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572116.715206:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572117.181052:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572117.181496:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495240960 00000100:00100000:2.0:1788572117.181508:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495240960 00000100:00080000:1.0:1788572117.181544:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572117.181593:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:2.0:1788572117.181607:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+9:10301:x1875453495240960:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572117.181702:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572117.181731:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e67 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.181868:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.181887:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.181901:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.181919:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.181939:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.181948:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182178:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182188:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182201:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182206:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572117.182209:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182214:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182224:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0481bf900) 00010000:00010000:2.0:1788572117.182226:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572117.182229:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182234:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182241:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182244:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182265:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182269:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572117.182838:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182852:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182860:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88c0593eff00) 00010000:00010000:2.0:1788572117.182862:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572117.182864:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182868:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff87e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182899:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff870 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e67 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182905:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0481bf900) 00010000:00010000:2.0:1788572117.182906:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572117.182909:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e67 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.182915:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c200, rc 0) 00000100:00100000:2.0:1788572117.183004:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+9:10301:x1875453495240960:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1400us (1963us total) trans 0 rc 301/301 00000100:00100000:2.0:1788572117.183013:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:1.0:1788572117.200054:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572117.200147:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495241216 00000100:00100000:2.0:1788572117.200156:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495241216 00000100:00100000:2.0:1788572117.200210:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:2.0:1788572117.200219:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+9:10301:x1875453495241216:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:2.0:1788572117.200442:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572117.200472:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90e00/0x977d9e7969bff82a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e52 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.200497:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0481bf900) 00010000:00010000:2.0:1788572117.200509:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572117.200937:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.200953:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.200965:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.200978:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.200985:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.200992:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572117.203171:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788572117.203191:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.203203:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.203211:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.203228:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572117.203233:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.203242:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.203822:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572117.203826:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572117.203832:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.203840:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff885 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572117.203863:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e2217d1 reply state 00000000d4346e3a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572117.203872:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572117.204002:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+10:10301:x1875453495241216:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 3778us (3954us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788572117.204012:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00010000:00010000:2.0:1788572117.207219:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.207237:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.207245:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.207303:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572117.207308:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.207317:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.207333:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88c0593ef300) 00010000:00010000:2.0:1788572117.207336:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572117.207341:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.207349:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bff88c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572117.289436:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572117.289485:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495241344 00000100:00100000:1.0:1788572117.289495:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495241344 00000100:00100000:1.0:1788572117.289561:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1788572117.289573:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+9:10309:x1875453495241344:12345-192.168.202.2@tcp:101:lctl.0 00010000:00010000:1.0:1788572117.289602:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572117.289627:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e6e expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.289720:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff89a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.289738:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff89a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.289753:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff89a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572117.289790:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788572117.289794:0:10431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572117.289839:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff89a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.289864:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e6e expref: 11 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.289884:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff89a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e6e expref: 10 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.289893:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:1.0:1788572117.289896:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572117.289899:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db2a00, rc 0) 00000100:00100000:1.0:1788572117.289953:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+10:10309:x1875453495241344:12345-192.168.202.2@tcp:101:lctl.0 Request processed in 382us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572117.289960:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1788572117.355789:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572117.355891:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495241472 00000100:00100000:3.0:1788572117.355905:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495241472 00000100:00100000:3.0:1788572117.355981:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:3.0:1788572117.355998:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+10:10315:x1875453495241472:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788572117.356038:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572117.356070:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff8a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e75 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356165:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356196:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356210:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356226:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356233:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356241:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356453:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff8b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356462:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356470:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572117.356507:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788572117.356512:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572117.356560:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356575:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356582:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356589:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356596:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572117.356600:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356608:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356623:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:3.0:1788572117.356632:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572117.356637:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356644:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff8a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356657:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356663:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356669:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356674:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572117.356676:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356682:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356690:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88c059bcdf00) 00010000:00010000:3.0:1788572117.356692:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572117.356695:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356701:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff8af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356737:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff8a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e75 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356768:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff8b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e75 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.356776:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:3.0:1788572117.356778:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788572117.356781:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387600, rc 0) 00000100:00100000:3.0:1788572117.356846:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+11:10315:x1875453495241472:12345-192.168.202.2@tcp:101:bash.0 Request processed in 854us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572117.356854:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:1.0:1788572117.359897:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572117.359978:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495241728 00000100:00100000:2.0:1788572117.359989:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495241728 00000100:00100000:2.0:1788572117.360069:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:2.0:1788572117.360081:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+11:10315:x1875453495241728:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572117.360103:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572117.360129:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff8bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e7c expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.360315:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.360334:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.360360:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.360408:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.360417:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.360424:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572117.361128:0:10431:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788572117.361340:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361351:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361359:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361396:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361404:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361411:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361417:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572117.361429:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361437:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361452:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572117.361455:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572117.361461:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361467:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff8c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572117.361481:0:10431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bd8aa11 reply state 00000000c7410282 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572117.361491:0:10431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572117.361526:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bff8bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e7c expref: 14 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361540:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e7c expref: 13 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.361548:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572117.361550:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572117.361553:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c000, rc 0) 00000100:00100000:2.0:1788572117.361636:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+14:10315:x1875453495241728:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1557us (1748us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788572117.361644:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00010000:00010000:2.0:1788572117.363751:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.363768:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.363775:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.363780:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572117.363785:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.363793:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.363818:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0593ef300) 00010000:00010000:2.0:1788572117.363822:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572117.363827:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.363834:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572117.367887:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572117.367975:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495241856 00000100:00100000:0.0:1788572117.367987:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495241856 00000100:00100000:0.0:1788572117.368045:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788572117.368058:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875453495241856:12345-192.168.202.2@tcp:8:bash.0 00010000:00080000:0.0:1788572117.368103:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp t0 exp 0000000000000000 cur 338 last 0 00000020:00000080:0.0:1788572117.368138:0:6681:0:(genops.c:1385:class_connect()) connect: client 78708c10-ef63-4de2-8b1c-aff484c98227, cookie 0x977d9e7969bff8e0 00002000:00100000:0.0:1788572117.368151:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 78708c10-ef63-4de2-8b1c-aff484c98227/ffff88c076c6e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572117.368187:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572117.368501:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788572117.368541:0:6681:0:(import.c:65:import_set_state_nolock()) ffff88c076c6a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572117.368624:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2352:x1875453495241856:12345-192.168.202.2@tcp:8:bash.0 Request processed in 566us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572117.368633:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:1.0:1788572117.374865:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572117.375007:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495241984 00000100:00100000:2.0:1788572117.375028:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495241984 00000100:00100000:2.0:1788572117.375101:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:2.0:1788572117.375112:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:0:x1875453495241984:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572117.375130:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572117.375154:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e83 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572117.375202:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788572117.375220:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1788572117.375225:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572117.375234:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e83 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.375290:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e83 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.375306:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c200, rc 0) 00000100:00100000:2.0:1788572117.375366:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:0:x1875453495241984:12345-192.168.202.2@tcp:101:bash.0 Request processed in 255us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572117.375373:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00080000:1.0:1788572117.375699:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572117.379588:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572117.379654:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495242112 00000100:00100000:0.0:1788572117.379664:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495242112 00000100:00100000:0.0:1788572117.379771:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788572117.379782:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:10315:x1875453495242112:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572117.379805:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572117.379824:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e8a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572117.379858:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e83 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572117.379867:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572117.379871:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572117.379877:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572117.379909:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e83 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572117.379922:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e83 expref: 8 pid: 6680 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572117.379945:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1875453518348416:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572117.380059:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0593ba900 going to sleep for 11 seconds 00000100:00100000:1.0:1788572117.381595:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1875453518348416:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572117.381628:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.381648:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a800, rc 0) 00000100:00100000:1.0:1788572117.381711:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:10315:x1875453495242112:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1930us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572117.381719:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1788572117.381957:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572117.382239:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495242240 00000100:00100000:0.0:1788572117.382285:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495242240 00010000:00010000:0.0:1788572117.382316:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e83 expref: 8 pid: 6680 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572117.382455:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:1.0:1788572117.382478:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495242240:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572117.382494:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572117.382521:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e83 expref: 8 pid: 6680 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.382535:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e83 expref: 8 pid: 6680 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.382559:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969bff8e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e83 expref: 8 pid: 6680 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.382573:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572117.382577:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572117.382584:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.382608:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.382646:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572117.382660:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5815:1875453518348544:192.168.202.2@tcp:105: 00000100:00100000:1.0:1788572117.382730:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0518b23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572117.389178:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572117.389296:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495242496 00000100:00100000:0.0:1788572117.389305:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495242496 00000100:00100000:0.0:1788572117.389353:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:0.0:1788572117.389374:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+13:10315:x1875453495242496:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:1.0:1788572117.389662:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5815:1875453518348544:192.168.202.2@tcp:105: 00010000:00010000:1.0:1788572117.389688:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572117.389714:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+14:10315:x1875453495242496:12345-192.168.202.2@tcp:35:bash.0 Request processed in 351us (547us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788572117.389719:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495242240:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 7241us (7761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572117.389727:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788572117.389735:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1788572117.469546:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572117.469751:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495242752 00000100:00100000:2.0:1788572117.469762:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495242752 00000100:00100000:2.0:1788572117.469832:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:2.0:1788572117.469843:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+14:10325:x1875453495242752:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572117.469868:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572117.469897:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e91 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572117.469985:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788572117.470140:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e91 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.470170:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:2.0:1788572117.470172:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572117.470176:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff8f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e91 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.470188:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d000, rc 0) 00000100:00100000:2.0:1788572117.470318:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+15:10325:x1875453495242752:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 476us (781us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788572117.470326:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:3.0:1788572117.473514:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572117.473639:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495243008 00000100:00100000:0.0:1788572117.473649:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495243008 00000100:00100000:0.0:1788572117.473712:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788572117.473722:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+15:10325:x1875453495243008:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788572117.473958:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+16:10325:x1875453495243008:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 237us (454us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788572117.473965:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:3.0:1788572117.544108:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572117.544657:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495243136 00000100:00100000:2.0:1788572117.544667:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495243136 00000100:00100000:2.0:1788572117.544741:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:2.0:1788572117.544752:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+16:10330:x1875453495243136:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572117.544775:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572117.544795:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e98 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.544867:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff90a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.544881:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff90a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.544893:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff90a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572117.544931:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788572117.544949:0:10431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572117.544977:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff90a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.545007:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e98 expref: 18 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.545041:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff90a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e98 expref: 17 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.545050:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572117.545053:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572117.545068:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0cc00, rc 0) 00000100:00100000:2.0:1788572117.545148:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+17:10330:x1875453495243136:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 397us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572117.545155:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:1.0:1788572117.553075:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572117.553169:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495243392 00000100:00100000:3.0:1788572117.553178:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495243392 00000100:00100000:3.0:1788572117.553240:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1788572117.553549:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+17:10330:x1875453495243392:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788572117.553572:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572117.553597:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff911 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10e9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.553701:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.553715:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.553743:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572117.553758:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788572117.553900:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff911 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e9f expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.553920:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e9f expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.553929:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:3.0:1788572117.553931:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572117.553935:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387200, rc 0) 00000100:00100000:3.0:1788572117.554009:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+19:10330:x1875453495243392:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 759us (953us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788572117.554027:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1788572117.558835:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572117.558922:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572117.559023:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495243776 00000100:00100000:0.0:1788572117.559036:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495243776 00000100:00100000:0.0:1788572117.559138:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1788572117.559151:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+19:2353:x1875453495243776:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572117.559169:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572117.559197:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bff918 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e9f expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572117.559216:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:0.0:1788572117.559221:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572117.559325:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+18:2353:x1875453495243776:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 177us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572117.559333:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:2.0:1788572117.559947:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495243648 00000100:00100000:2.0:1788572117.559956:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495243648 00000100:00100000:2.0:1788572117.560002:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:2.0:1788572117.560011:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+18:10330:x1875453495243648:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572117.560044:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572117.560072:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff926 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ea6 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.560169:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bff92d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.560183:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bff92d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.560207:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bff92d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572117.560221:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788572117.560657:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ea6 expref: 21 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.560677:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bff92d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ea6 expref: 20 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.560685:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572117.560688:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788572117.560691:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572117.560752:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+20:10330:x1875453495243648:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 741us (1929us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788572117.560758:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1788572117.570159:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572117.570280:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495243904 00000100:00100000:2.0:1788572117.570289:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495243904 00000100:00100000:2.0:1788572117.570344:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1788572117.570354:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495243904:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:2.0:1788572117.570555:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.570578:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.570587:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572117.570607:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572117.570612:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.570648:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.570662:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 7 pid: 6681 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572117.570676:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1875453518348672:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572117.570768:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c046f7b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788572117.573651:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572117.573911:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495244032 00000100:00100000:3.0:1788572117.573919:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495244032 00002000:00100000:3.0:1788572117.573969:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff88c07c34ed80 x1875453495244032/t0(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:533/0 lens 504/0 e 0 to 0 dl 1788572128 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788572117.573980:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07c34ed80 with x1875453495244032 ext(0->12) 00010000:00010000:3.0:1788572117.573991:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 8 pid: 6681 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.574045:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 8 pid: 6681 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572117.574054:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88c07c34ed80 00000100:00100000:3.0:1788572117.574104:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1788572117.574115:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495244032:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:2.0:1788572117.574659:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1875453518348672:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572117.574689:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788572117.631735:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000100:00100000:1.0:1788572117.632842:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:2355:x1875453495244032:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 58721us (59193us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788572117.632861:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00002000:00100000:1.0:1788572117.632874:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff88c07c34ed80 x1875453495244032/t4294967299(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:533/0 lens 504/448 e 0 to 0 dl 1788572128 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572117.632885:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07c34ed80 with x1875453495244032 ext(0->12) 00010000:00010000:1.0:1788572117.632895:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 9 pid: 6681 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.632921:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 9 pid: 6681 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572117.632929:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88c07c34ed80 00000100:00100000:1.0:1788572117.636691:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572117.636726:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495244160 00000100:00100000:1.0:1788572117.636736:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495244160 00010000:00010000:1.0:1788572117.636774:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 9 pid: 6681 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572117.636812:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:1.0:1788572117.636822:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+9:2354:x1875453495244160:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572117.636836:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788572117.636855:0:11167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788572117.636858:0:11167:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788572117 00002000:00010000:1.0:1788572117.636860:0:11167:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788572117 00002000:00010000:1.0:1788572117.636863:0:11167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788572117 00010000:00010000:1.0:1788572117.636869:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 9 pid: 6681 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.636882:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 9 pid: 6681 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.636905:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f6191b2/0x977d9e7969bff8ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e8a expref: 9 pid: 6681 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.636935:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788572117.636940:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788572117.636946:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.636956:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.636983:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572117.637662:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+8:2354:x1875453495244160:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 227us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572117.637674:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00010000:00010000:2.0:1788572117.638351:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.638364:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.638395:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.638403:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.638422:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.638429:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572117.638434:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.638443:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.638459:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.638468:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fe376db/0x977d9e7969bff93b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572117.638546:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495243904:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 68191us (68397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572117.638555:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1788572117.646762:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572117.648269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495244416 00000100:00100000:3.0:1788572117.648282:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495244416 00000100:00100000:3.0:1788572117.648345:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788572117.648356:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+20:10330:x1875453495244416:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:3.0:1788572117.648421:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bff92d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ea6 expref: 20 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572117.648844:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788572117.648905:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788572117.655540:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788572117.655635:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.655655:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e7c expref: 24 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.655665:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.655703:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e7c expref: 24 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.655718:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e7c expref: 24 pid: 10431 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572117.655745:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1875453518348800:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572117.655845:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572117.661692:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5834:1875453518348800:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572117.661727:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572117.678880:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572117.679287:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495244544 00000100:00100000:3.0:1788572117.679300:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495244544 00010000:00010000:3.0:1788572117.679346:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e7c expref: 25 pid: 10431 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572117.679393:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:3.0:1788572117.679405:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+25:2355:x1875453495244544:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572117.679421:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572117.679430:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e7c expref: 25 pid: 10431 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.679461:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e7c expref: 25 pid: 10431 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.679485:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bff8d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e7c expref: 25 pid: 10431 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.679501:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:3.0:1788572117.679507:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.679517:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.679525:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.679553:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572117.679579:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.679597:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572117.679610:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+24:2355:x1875453495244544:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 206us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572117.679618:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000001:00080000:2.0:1788572117.679724:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788572117.682324:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788572117.682608:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1875453518348928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788572117.682734:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572117.682765:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572117.683229:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518348928 00000100:00100000:0.0:1788572117.683273:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518348928 00000100:00100000:0.0:1788572117.683424:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788572117.683454:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875453518348928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788572117.683613:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1875453518348928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572117.683622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788572117.683767:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572117.684281:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1875453518348928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788572117.685554:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788572117.685668:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1875453518349056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788572117.685755:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572117.685795:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572117.685876:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518349056 00000100:00100000:3.0:1788572117.685885:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518349056 00000100:00100000:3.0:1788572117.685936:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572117.685945:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1875453518349056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788572117.686173:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1875453518349056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 229us (418us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788572117.686181:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788572117.686463:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5834:1875453518349056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788572117.686524:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788572117.686568:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.686580:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.686588:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.686595:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572117.686601:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.686610:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.686626:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:1.0:1788572117.686630:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788572117.686635:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.686642:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff942 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572117.686835:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788572117.687073:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788572117.687084:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338477835241ns, next at 339477832823ns, rc = 0 00000001:00080000:1.0:1788572117.687091:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788572117.687127:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:1.0:1788572117.687130:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788572117.687138:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bff92d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ea6 expref: 28 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572117.687578:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+27:10330:x1875453495244416:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 39222us (40824us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788572117.687587:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000020:00080000:1.0:1788572117.687591:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000001:00080000:3.0:1788572117.691524:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00000001:00080000:3.0:1788572117.691546:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000100:00100000:0.0:1788572117.698040:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572117.698134:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495244672 00000100:00100000:2.0:1788572117.698143:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495244672 00000100:00100000:2.0:1788572117.698204:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:2.0:1788572117.698215:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+19:10330:x1875453495244672:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572117.698280:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572117.698305:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff949 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ead expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.698368:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff949 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ead expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.698384:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff949 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ead expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572117.698427:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:2.0:1788572117.698430:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572117.698434:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d000, rc 0) 00000100:00100000:2.0:1788572117.698496:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+20:10330:x1875453495244672:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 283us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572117.698503:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:3.0:1788572117.709366:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572117.709452:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495244928 00000100:00100000:1.0:1788572117.709464:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495244928 00000100:00100000:1.0:1788572117.709525:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788572117.709536:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c06bdb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+20:10330:x1875453495244928:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572117.709780:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c06bdb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+21:10330:x1875453495244928:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 245us (425us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788572117.709788:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00010000:00010000:3.0:1788572117.738809:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572117.913612:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572117.913729:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495245184 00000100:00100000:1.0:1788572117.913739:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495245184 00000100:00100000:1.0:1788572117.913801:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:1.0:1788572117.913812:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+21:10342:x1875453495245184:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572117.913850:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572117.913874:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10eb4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572117.913979:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788572117.914144:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff950 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10eb4 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.914159:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:1.0:1788572117.914162:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572117.914167:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10eb4 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572117.914181:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c046db3600, rc 0) 00000100:00100000:1.0:1788572117.914243:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+22:10342:x1875453495245184:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 433us (641us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788572117.914303:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1788572117.917997:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572117.918756:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495245312 00000100:00100000:3.0:1788572117.918770:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495245312 00000100:00100000:3.0:1788572117.918838:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:3.0:1788572117.918848:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+22:10342:x1875453495245312:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:3.0:1788572117.918935:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.918953:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.918966:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.918981:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.918988:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.918994:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919408:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919419:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919439:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572117.919478:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919491:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919507:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919514:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919520:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572117.919524:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919530:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919543:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:3.0:1788572117.919546:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572117.919551:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919556:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bff95e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919569:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919581:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919587:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919592:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572117.919595:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919601:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919608:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c059bcd200) 00010000:00010000:3.0:1788572117.919611:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572117.919614:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919619:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bff965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919636:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919642:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919647:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919651:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572117.919661:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919667:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919675:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:3.0:1788572117.919677:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572117.919680:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572117.919686:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bff96c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572117.920659:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+22:10342:x1875453495245312:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 1805us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572117.920671:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:3.0:1788572117.926139:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572117.926236:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495245568 00000100:00100000:1.0:1788572117.926290:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495245568 00000100:00100000:1.0:1788572117.926341:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788572117.926352:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+22:10342:x1875453495245568:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572117.926604:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+23:10342:x1875453495245568:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 254us (474us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788572117.926612:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1788572118.049757:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572118.051391:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495245824 00000100:00100000:1.0:1788572118.051407:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495245824 00000100:00100000:1.0:1788572118.051497:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:1.0:1788572118.051508:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+23:10345:x1875453495245824:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572118.051535:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572118.051576:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff973 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ebb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.051657:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.051672:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.051684:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.051700:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.051706:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.051713:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.051986:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.051996:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052016:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572118.052029:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788572118.052135:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052154:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052161:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052167:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572118.052172:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052180:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052193:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:1.0:1788572118.052196:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572118.052201:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052207:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3800/0x977d9e7969bff97a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052219:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052224:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052241:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052324:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572118.052334:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052340:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052349:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c058eac500) 00010000:00010000:1.0:1788572118.052351:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572118.052354:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052360:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3400/0x977d9e7969bff981 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052405:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db3600/0x977d9e7969bff973 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ebb expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052426:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ebb expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.052434:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:1.0:1788572118.052436:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572118.052439:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994c00, rc 0) 00000100:00100000:1.0:1788572118.052707:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+25:10345:x1875453495245824:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1199us (2959us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788572118.052715:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1788572118.069114:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572118.076904:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495245952 00000100:00100000:2.0:1788572118.076921:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495245952 00000100:00100000:2.0:1788572118.077017:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788572118.077039:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+25:10345:x1875453495245952:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:2.0:1788572118.077368:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.077387:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.077400:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.077434:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.077441:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.077448:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.077454:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572118.077472:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.077479:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.077491:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:2.0:1788572118.077494:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572118.077500:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.077507:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572118.078098:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+25:10345:x1875453495245952:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 1055us (8980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572118.078108:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:3.0:1788572118.094559:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572118.094856:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495246208 00000100:00100000:2.0:1788572118.094867:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495246208 00000100:00100000:2.0:1788572118.094927:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788572118.094937:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+25:10345:x1875453495246208:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572118.095197:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+26:10345:x1875453495246208:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 261us (647us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788572118.095205:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1788572118.446503:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572118.446644:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495246464 00000100:00100000:2.0:1788572118.446654:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495246464 00000100:00100000:2.0:1788572118.446719:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:2.0:1788572118.446729:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+26:10376:x1875453495246464:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:2.0:1788572118.446753:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572118.446788:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff99d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ec2 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.446886:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bff9a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.446901:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bff9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.446915:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bff9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572118.446928:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788572118.447429:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff99d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec2 expref: 29 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.447450:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bff9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec2 expref: 28 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.447460:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:2.0:1788572118.447463:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572118.447466:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d600, rc 0) 00000100:00100000:2.0:1788572118.447569:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+28:10376:x1875453495246464:12345-192.168.202.2@tcp:101:cat.0 Request processed in 841us (1075us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788572118.447577:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:0.0:1788572118.454978:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572118.455512:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495246720 00000100:00100000:1.0:1788572118.455523:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495246720 00000100:00100000:1.0:1788572118.455634:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1788572118.455645:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+28:10376:x1875453495246720:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:1.0:1788572118.455934:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+29:10376:x1875453495246720:12345-192.168.202.2@tcp:35:cat.0 Request processed in 290us (965us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788572118.455941:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788572118.458083:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572118.458284:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495246848 00000100:00100000:0.0:1788572118.458296:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495246848 00000100:00100000:0.0:1788572118.458365:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1788572118.458375:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058e7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+29:2354:x1875453495246848:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572118.458405:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572118.458437:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bff9a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec2 expref: 29 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572118.458459:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:0.0:1788572118.458465:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572118.458513:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058e7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+28:2354:x1875453495246848:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 141us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572118.458520:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:3.0:1788572118.563347:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572118.563508:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495247104 00000100:00100000:1.0:1788572118.563519:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495247104 00000100:00100000:1.0:1788572118.563594:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1788572118.563605:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+28:10382:x1875453495247104:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:1.0:1788572118.563629:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572118.563633:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788572118.563659:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bff90a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e98 expref: 28 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.563680:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:1.0:1788572118.563686:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572118.563699:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969bff9b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ec9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.563805:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.563830:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ebb expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.563839:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.563871:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ebb expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.563903:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ebb expref: 28 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572118.563915:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518349184:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572118.564015:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572118.574599:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572118.574721:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518349184:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572118.574749:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572118.575234:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495247232 00000100:00100000:3.0:1788572118.575244:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495247232 00010000:00010000:3.0:1788572118.575331:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ebb expref: 29 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572118.575378:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:3.0:1788572118.575389:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+29:2356:x1875453495247232:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572118.575423:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572118.575431:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ebb expref: 29 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572118.575445:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ebb expref: 29 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572118.575470:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bff988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ebb expref: 29 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572118.575487:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:3.0:1788572118.575492:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572118.575501:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572118.575509:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572118.575547:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572118.575610:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+28:2356:x1875453495247232:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 222us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572118.575619:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00010000:00010000:2.0:1788572118.575671:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.575679:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572118.575711:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788572118.575899:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969bff9b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec9 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.575916:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec9 expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.575923:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:2.0:1788572118.575926:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572118.575928:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994e00, rc 0) 00000100:00100000:2.0:1788572118.575970:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+28:10382:x1875453495247104:12345-192.168.202.2@tcp:101:dd.0 Request processed in 12367us (12635us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788572118.575978:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:0.0:1788572118.580748:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572118.580843:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495247488 00000100:00100000:1.0:1788572118.580854:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495247488 00000100:00100000:1.0:1788572118.580918:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:1.0:1788572118.580929:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+28:10382:x1875453495247488:12345-192.168.202.2@tcp:36:dd.0 00010000:00010000:1.0:1788572118.581234:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.581278:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572118.581289:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788572118.581346:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788572118.581370:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099f3adcb reply state 000000006a64b4de transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572118.581379:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572118.581499:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+31:10382:x1875453495247488:12345-192.168.202.2@tcp:36:dd.0 Request processed in 571us (760us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788572118.581507:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000020:00080000:1.0:1788572118.581512:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572118.588889:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.588908:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.588915:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.588921:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572118.588926:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.588934:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.588973:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:2.0:1788572118.588976:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572118.588982:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.589001:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bff9c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572118.760430:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572119.042703:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572119.042880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495247616 00000100:00100000:2.0:1788572119.042890:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495247616 00000100:00080000:1.0:1788572119.042955:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572119.042963:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:2.0:1788572119.042985:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+30:10396:x1875453495247616:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:2.0:1788572119.043015:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572119.043036:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ed0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043096:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043115:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043124:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043137:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043144:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043167:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043814:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043826:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec9 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043832:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043860:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec9 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.043871:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec9 expref: 31 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572119.043881:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518349312:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572119.044022:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572119.047351:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518349312:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572119.047404:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572119.048538:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572119.048710:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495247872 00000100:00100000:2.0:1788572119.048729:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495247872 00000100:00100000:2.0:1788572119.048924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788572119.048950:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+32:5595:x1875453495247872:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788572119.049713:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+33:5595:x1875453495247872:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 776us (1179us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788572119.049723:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1788572119.053631:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572119.053954:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495248000 00000100:00100000:0.0:1788572119.053963:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495248000 00010000:00010000:0.0:1788572119.054025:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec9 expref: 33 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572119.054067:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1788572119.054078:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+33:2355:x1875453495248000:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572119.054093:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572119.054100:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec9 expref: 33 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.054115:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec9 expref: 33 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.054169:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969bff9b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ec9 expref: 33 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.054189:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:0.0:1788572119.054195:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.054415:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.054423:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.054459:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572119.054512:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+32:2355:x1875453495248000:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 435us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572119.054520:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00010000:00010000:1.0:1788572119.055076:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055087:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572119.055147:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788572119.055151:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572119.055201:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055216:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055225:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055231:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055238:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055244:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572119.055279:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055288:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055601:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:1.0:1788572119.055605:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572119.055617:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055624:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bff9d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055643:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055649:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055654:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055659:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0da00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572119.055662:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055667:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055676:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0593ef500) 00010000:00010000:1.0:1788572119.055678:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572119.055681:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055687:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055738:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed0 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055752:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed0 expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.055759:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:1.0:1788572119.055761:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572119.055764:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:1.0:1788572119.055827:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+31:10396:x1875453495247616:12345-192.168.202.2@tcp:101:stat.0 Request processed in 12854us (13136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572119.055834:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:3.0:1788572119.145999:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518349696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572119.146031:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07679a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518349440:0@lo:400:kworker.0 00000100:00100000:3.0:1788572119.146071:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572119.146071:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572119.146139:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788572119.146146:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518349824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572119.146158:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518349568:0@lo:400:kworker.0 00000100:00100000:3.0:1788572119.146177:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572119.146178:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572119.146277:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518349440 00000100:00100000:2.0:1788572119.146285:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518349440 00000100:00100000:2.0:1788572119.146331:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788572119.146341:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518349440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572119.146389:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518349440:12345-0@lo:400:kworker.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.146397:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788572119.146445:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518349696 00000100:00100000:2.0:1788572119.146449:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518349696 00000100:00100000:2.0:1788572119.146482:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518349568 00000100:00100000:2.0:1788572119.146485:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518349568 00000100:00100000:2.0:1788572119.146503:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788572119.146510:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518349696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572119.146542:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518349696:12345-0@lo:400:kworker.0 Request processed in 34us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.146562:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788572119.146576:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788572119.146583:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518349568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572119.146610:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518349568:12345-0@lo:400:kworker.0 Request processed in 28us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.146615:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788572119.146631:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572119.146667:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518349824 00000100:00100000:2.0:1788572119.146679:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518349824 00000100:00100000:2.0:1788572119.146711:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788572119.146717:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518349824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572119.146760:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518349824:12345-0@lo:400:kworker.0 Request processed in 43us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.146766:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788572119.146781:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572119.147269:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518349568:0@lo:400:kworker.0 00000100:00100000:3.0:1788572119.147280:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07679a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518350080:0@lo:400:kworker.0 00000100:00100000:3.0:1788572119.147313:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572119.147349:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518349696:0@lo:400:kworker.0 00000100:00100000:2.0:1788572119.148377:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518350080 00000100:00100000:2.0:1788572119.148386:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518350080 00000100:00100000:2.0:1788572119.148452:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788572119.148463:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518350080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572119.148526:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518350080:12345-0@lo:400:kworker.0 Request processed in 66us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.148533:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788572119.148674:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572119.148705:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07679a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518350080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572119.149148:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07679a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518349440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572119.149161:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518349952:0@lo:400:kworker.0 00000100:00100000:1.0:1788572119.149214:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572119.149406:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518349952 00000100:00100000:2.0:1788572119.149421:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518349952 00000100:00100000:2.0:1788572119.149478:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788572119.149487:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518349952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572119.149527:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518349952:12345-0@lo:400:kworker.0 Request processed in 42us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.149534:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1788572119.149686:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572119.149750:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518349952:0@lo:400:kworker.0 00000100:00100000:0.0:1788572119.150493:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518349824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572119.163943:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572119.164398:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495248256 00000100:00100000:2.0:1788572119.164409:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495248256 00000100:00100000:2.0:1788572119.164484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:2.0:1788572119.164496:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+31:10402:x1875453495248256:12345-192.168.202.2@tcp:36:truncate.0 00010000:00010000:2.0:1788572119.164565:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572119.164593:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed0 expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.164626:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:2.0:1788572119.164631:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572119.164827:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.164841:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.164851:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572119.164899:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788572119.164922:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033536ba5 reply state 00000000861906b5 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572119.164930:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572119.165088:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+33:10402:x1875453495248256:12345-192.168.202.2@tcp:36:truncate.0 Request processed in 593us (1154us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788572119.165095:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000020:00080000:2.0:1788572119.165101:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572119.167875:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.167891:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.167899:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.167905:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572119.167925:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.167933:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.167949:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:2.0:1788572119.167952:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572119.167957:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.167963:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572119.388691:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572119.389074:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495248384 00000100:00100000:2.0:1788572119.389086:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495248384 00000100:00100000:2.0:1788572119.389159:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:2.0:1788572119.389169:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+32:10416:x1875453495248384:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:2.0:1788572119.389463:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572119.389486:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ed7 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.389562:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.389577:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.389590:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.389606:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.389626:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.389633:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.389944:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.389953:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.389984:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572119.390024:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788572119.390029:0:10431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572119.390128:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390555:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390565:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390571:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390579:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390597:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572119.390602:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390610:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390623:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572119.390626:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572119.390632:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390640:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bff9f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390654:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390660:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390666:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390671:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0da00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572119.390674:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390681:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390701:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0593ef300) 00010000:00010000:2.0:1788572119.390703:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572119.390707:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390712:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bff9ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390752:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bff9f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed7 expref: 34 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390766:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed7 expref: 33 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.390774:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:2.0:1788572119.390776:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572119.390779:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d400, rc 0) 00000100:00100000:2.0:1788572119.391400:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+33:10416:x1875453495248384:12345-192.168.202.2@tcp:101:stat.0 Request processed in 2228us (2716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.391409:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:3.0:1788572119.395420:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572119.395459:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572119.395503:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572119.395539:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495248640 00000100:00100000:3.0:1788572119.395549:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495248640 00000100:00100000:3.0:1788572119.395613:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1788572119.395624:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495248640:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572119.395691:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495248640:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572119.395698:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00080000:3.0:1788572119.395720:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572119.395896:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495248512 00000100:00100000:2.0:1788572119.395902:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495248512 00000100:00100000:2.0:1788572119.395940:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 290 00000100:00100000:2.0:1788572119.395947:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495248512:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572119.395993:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495248512:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 46us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572119.396000:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 290 00000100:00100000:1.0:1788572119.396570:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495248768 00000100:00100000:1.0:1788572119.396576:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495248768 00000100:00100000:1.0:1788572119.396632:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 143 00000100:00100000:1.0:1788572119.396639:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495248768:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572119.396685:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495248768:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 46us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572119.396703:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 143 00000100:00080000:3.0:1788572119.397203:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572119.486770:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572119.486891:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495249024 00000100:00100000:1.0:1788572119.486900:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495249024 00000100:00100000:1.0:1788572119.486975:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:1.0:1788572119.486988:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+33:10426:x1875453495249024:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572119.487021:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572119.487055:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffa0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ede expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572119.487174:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788572119.487345:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffa0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ede expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.487362:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:1.0:1788572119.487365:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572119.487371:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffa0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ede expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.487386:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994a00, rc 0) 00000100:00100000:1.0:1788572119.487473:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+34:10426:x1875453495249024:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 487us (713us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788572119.487481:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:1.0:1788572119.491596:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572119.491685:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495249280 00000100:00100000:2.0:1788572119.491695:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495249280 00000100:00100000:2.0:1788572119.491762:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788572119.491772:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+34:10426:x1875453495249280:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572119.492071:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+35:10426:x1875453495249280:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 299us (486us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788572119.492079:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788572119.627676:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572119.630774:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495249536 00000100:00100000:1.0:1788572119.630803:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495249536 00000100:00100000:1.0:1788572119.630890:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1788572119.630902:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+35:10432:x1875453495249536:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788572119.630945:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572119.630979:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffa1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ee5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.631088:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.631106:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed7 expref: 36 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.631115:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.631176:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed7 expref: 36 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.631192:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed7 expref: 36 pid: 10431 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572119.631208:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518350208:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572119.631383:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572119.638068:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518350208:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572119.638109:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572119.638767:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572119.638952:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495249664 00000100:00100000:0.0:1788572119.638972:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495249664 00010000:00010000:0.0:1788572119.639032:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed7 expref: 37 pid: 10431 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572119.639074:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:0.0:1788572119.639084:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+37:2355:x1875453495249664:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572119.639118:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572119.639126:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed7 expref: 37 pid: 10431 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.639149:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed7 expref: 37 pid: 10431 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.639173:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffa06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ed7 expref: 37 pid: 10431 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.639201:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:0.0:1788572119.639207:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.639218:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.639225:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.639302:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572119.639309:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.639318:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572119.639341:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788572119.639521:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffa1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ee5 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.639536:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ee5 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.639542:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:2.0:1788572119.639545:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572119.639548:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995800, rc 0) 00000100:00100000:2.0:1788572119.639597:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+37:10432:x1875453495249536:12345-192.168.202.2@tcp:101:bash.0 Request processed in 8698us (11933us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788572119.639605:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:0.0:1788572119.639733:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+36:2355:x1875453495249664:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 649us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572119.639740:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:3.0:1788572119.645925:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572119.646230:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495249920 00000100:00100000:1.0:1788572119.646241:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495249920 00000100:00100000:1.0:1788572119.650148:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:1.0:1788572119.650201:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+36:10432:x1875453495249920:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:1.0:1788572119.650554:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.650585:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.650597:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788572119.650653:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788572119.650678:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060f8b873 reply state 00000000d61c7d89 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572119.650687:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572119.650818:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+39:10432:x1875453495249920:12345-192.168.202.2@tcp:36:bash.0 Request processed in 636us (4905us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788572119.650826:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000020:00080000:1.0:1788572119.650832:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788572119.655820:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.655840:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.655868:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.655874:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572119.655879:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.655888:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.655907:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:0.0:1788572119.655910:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572119.655916:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.655923:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffa30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572119.656477:0:8034:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340447226403ns, next at 341447224431ns, rc = 0 00000100:00100000:2.0:1788572119.656620:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572119.656640:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518350336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572119.656702:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572119.657106:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518350336 00000100:00100000:0.0:1788572119.657115:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518350336 00000100:00100000:0.0:1788572119.657168:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788572119.657178:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518350336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572119.657828:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572119.657899:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518350336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 721us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572119.657906:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788572119.658484:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518350336:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788572119.659876:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788572119.662103:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572119.662574:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495250048 00000100:00100000:2.0:1788572119.662587:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495250048 00000100:00100000:2.0:1788572119.662663:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:2.0:1788572119.662675:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+38:10432:x1875453495250048:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572119.662703:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572119.662724:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffa37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10eec expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.662817:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.662833:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ee5 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.662843:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.662878:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ee5 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572119.662893:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ee5 expref: 39 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572119.662907:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518350464:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572119.665514:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf47603d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572119.667236:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572119.668371:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495250176 00000100:00100000:0.0:1788572119.668384:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495250176 00010000:00010000:0.0:1788572119.668456:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ee5 expref: 40 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572119.668497:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:0.0:1788572119.668508:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+40:2356:x1875453495250176:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572119.668524:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572119.668531:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ee5 expref: 40 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.668545:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ee5 expref: 40 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.668568:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:0.0:1788572119.668573:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.668577:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa22 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ee5 expref: 40 pid: 5832 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.668583:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.668590:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572119.668595:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518350464:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572119.668606:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572119.668618:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.668626:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.668632:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572119.668657:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+39:2356:x1875453495250176:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 151us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572119.668663:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000004:00200000:1.0:1788572119.668696:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788572119.668701:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572119.668857:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.668902:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffa37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10eec expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.668917:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10eec expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.668924:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:1.0:1788572119.668927:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572119.668930:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0cc00, rc 0) 00000100:00100000:1.0:1788572119.668971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+38:10432:x1875453495250048:12345-192.168.202.2@tcp:101:bash.0 Request processed in 6298us (6878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572119.668978:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:2.0:1788572119.671715:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572119.671869:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495250432 00000100:00100000:1.0:1788572119.671879:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495250432 00000100:00100000:1.0:1788572119.671990:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1788572119.672013:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c06bdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+38:10432:x1875453495250432:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:1.0:1788572119.672291:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c06bdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+39:10432:x1875453495250432:12345-192.168.202.2@tcp:35:bash.0 Request processed in 290us (583us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788572119.672298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1788572119.758522:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572119.758634:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495250688 00000100:00100000:0.0:1788572119.758644:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495250688 00000100:00100000:0.0:1788572119.758710:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:0.0:1788572119.758736:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+39:10442:x1875453495250688:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572119.758760:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572119.758780:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ef3 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572119.758883:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788572119.759025:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ef3 expref: 41 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.759039:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:0.0:1788572119.759042:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572119.759048:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ef3 expref: 41 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.759070:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ba00, rc 0) 00000100:00100000:0.0:1788572119.759132:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+40:10442:x1875453495250688:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 399us (619us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788572119.759139:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:3.0:1788572119.764822:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572119.765009:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495250816 00000100:00100000:1.0:1788572119.765019:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495250816 00000100:00100000:1.0:1788572119.765113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:1.0:1788572119.765125:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+40:10442:x1875453495250816:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:1.0:1788572119.765226:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765244:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765294:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765311:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765318:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765325:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765541:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765551:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765558:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572119.765597:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765610:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765624:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765631:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765636:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572119.765641:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765648:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765660:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:1.0:1788572119.765663:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572119.765668:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765673:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffa53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765685:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765690:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765696:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765701:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572119.765710:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765717:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765725:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c058eac500) 00010000:00010000:1.0:1788572119.765727:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572119.765730:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765735:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffa5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765749:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765755:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765761:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765766:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572119.765769:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765775:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765782:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:1.0:1788572119.765784:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572119.765806:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.765812:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572119.765899:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+40:10442:x1875453495250816:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 775us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572119.765909:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1788572119.772502:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572119.772604:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495251072 00000100:00100000:1.0:1788572119.772614:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495251072 00000100:00100000:1.0:1788572119.772677:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1788572119.772688:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+40:10442:x1875453495251072:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572119.772959:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+41:10442:x1875453495251072:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 261us (454us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788572119.772969:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00010000:00010000:1.0:1788572119.785141:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572119.814222:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572119.814504:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495251328 00000100:00100000:0.0:1788572119.814517:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495251328 00000100:00100000:0.0:1788572119.814584:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:0.0:1788572119.814595:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+41:10445:x1875453495251328:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572119.814617:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572119.814638:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10efa expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.814711:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.814739:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.814752:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.814768:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.814775:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.814782:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815066:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffa7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815076:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffa7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815084:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffa7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572119.815094:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788572119.815209:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815216:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815222:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815233:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ae00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572119.815237:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815244:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815293:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:0.0:1788572119.815296:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572119.815301:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815307:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bffa6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815325:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815331:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815337:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815341:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572119.815344:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815349:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815366:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0481bf000) 00010000:00010000:0.0:1788572119.815368:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572119.815371:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815377:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffa76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815420:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10efa expref: 44 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815435:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffa7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10efa expref: 43 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.815442:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:0.0:1788572119.815445:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572119.815447:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ac00, rc 0) 00000100:00100000:0.0:1788572119.815515:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+43:10445:x1875453495251328:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 921us (1304us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788572119.815523:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:3.0:1788572119.820436:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572119.820535:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495251456 00000100:00100000:1.0:1788572119.820545:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495251456 00000100:00100000:1.0:1788572119.820602:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:1.0:1788572119.820612:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+43:10445:x1875453495251456:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:1.0:1788572119.820678:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.820695:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.820707:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.820750:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.820758:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.820764:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.820770:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572119.820774:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.820781:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.820805:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:1.0:1788572119.820808:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572119.820813:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572119.820819:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffa8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572119.820897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+43:10445:x1875453495251456:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 285us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572119.820905:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:2.0:1788572119.823562:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572119.823648:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495251584 00000100:00100000:0.0:1788572119.823657:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495251584 00000100:00100000:0.0:1788572119.823719:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788572119.823729:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+43:2355:x1875453495251584:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572119.823744:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572119.823767:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffa7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10efa expref: 43 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572119.823822:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:0.0:1788572119.823827:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572119.823881:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076235180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+42:2355:x1875453495251584:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 153us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572119.823889:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:3.0:1788572119.827319:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572119.827487:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495251840 00000100:00100000:1.0:1788572119.827497:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495251840 00000100:00100000:1.0:1788572119.827557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1788572119.827584:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+42:10445:x1875453495251840:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572119.827827:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+43:10445:x1875453495251840:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 245us (517us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788572119.827834:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:3.0:1788572120.071766:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572120.071880:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495252096 00000100:00100000:0.0:1788572120.071893:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495252096 00000100:00100000:0.0:1788572120.071968:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:0.0:1788572120.071979:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+43:10463:x1875453495252096:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:0.0:1788572120.072012:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572120.072040:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffa92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f01 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.072138:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.072152:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.072164:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572120.072176:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788572120.072355:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffa92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f01 expref: 46 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.072381:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f01 expref: 45 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.072403:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:0.0:1788572120.072406:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788572120.072410:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ba00, rc 0) 00000100:00100000:0.0:1788572120.072470:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+45:10463:x1875453495252096:12345-192.168.202.2@tcp:101:cat.0 Request processed in 492us (716us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788572120.072477:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:3.0:1788572120.115359:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572120.115492:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495252224 00000100:00100000:1.0:1788572120.115515:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495252224 00000100:00100000:1.0:1788572120.115578:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:1.0:1788572120.115588:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+45:10464:x1875453495252224:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572120.115611:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572120.115632:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffaa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f08 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.115711:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffaae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.115726:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffaae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.115740:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffaae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572120.115787:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788572120.115791:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572120.115811:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffaae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.115839:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffaa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f08 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.115879:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffaae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f08 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.115888:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:1.0:1788572120.115890:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572120.115894:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994200, rc 0) 00000100:00100000:1.0:1788572120.115966:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+46:10464:x1875453495252224:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 378us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572120.115975:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:3.0:1788572120.128818:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572120.129546:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495252608 00000100:00100000:1.0:1788572120.129559:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495252608 00000100:00100000:1.0:1788572120.129677:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:1.0:1788572120.129689:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+46:10464:x1875453495252608:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572120.130445:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+47:10464:x1875453495252608:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 754us (1633us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788572120.130454:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788572120.133622:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572120.133720:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495252736 00000100:00100000:0.0:1788572120.133731:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495252736 00000100:00100000:0.0:1788572120.133802:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788572120.133813:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c367480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+47:10464:x1875453495252736:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:0.0:1788572120.133828:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788572120.133857:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffa3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10eec expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.133878:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffa99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f01 expref: 46 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.133897:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bff949 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ead expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.133908:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0593ef600) 00010000:00010000:0.0:1788572120.133919:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572120.133999:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c367480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+44:10464:x1875453495252736:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 187us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572120.134007:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788572120.139766:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572120.140018:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495252864 00000100:00100000:0.0:1788572120.140039:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495252864 00000100:00100000:0.0:1788572120.140098:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:0.0:1788572120.140108:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+44:10464:x1875453495252864:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:0.0:1788572120.140288:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.140304:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.140316:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572120.140617:0:10431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572120.141433:0:10431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788572120.141512:0:10431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788572120.141696:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+44:10464:x1875453495252864:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 1585us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572120.141717:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:2.0:1788572120.175839:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518350592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572120.175914:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572120.176378:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518350592 00000100:00100000:0.0:1788572120.176387:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518350592 00000100:00100000:0.0:1788572120.176434:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788572120.176443:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518350592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572120.176477:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572120.176535:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518350592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572120.176542:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788572120.176625:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518350592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572120.199842:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572120.199955:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495252992 00000100:00100000:1.0:1788572120.199966:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495252992 00000100:00100000:1.0:1788572120.200032:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:1.0:1788572120.200042:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+44:10466:x1875453495252992:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572120.200063:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572120.200084:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffabc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f0f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200151:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200181:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200387:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200407:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200415:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200421:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200655:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200664:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200671:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572120.200708:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788572120.200713:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572120.200732:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200745:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200766:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200773:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200779:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200785:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572120.200789:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200796:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200808:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:1.0:1788572120.200811:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572120.200816:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200822:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffac3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200834:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200840:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200845:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200856:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572120.200858:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200864:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200871:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c058eac500) 00010000:00010000:1.0:1788572120.200873:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572120.200876:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200882:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffaca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200915:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffabc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f0f expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200928:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f0f expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.200935:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bf000) 00010000:00010000:1.0:1788572120.200949:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572120.200952:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995e00, rc 0) 00000100:00100000:1.0:1788572120.201031:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+45:10466:x1875453495252992:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 989us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572120.201039:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000040:00080000:2.0:1788572120.680470:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788572120.680480:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572120.680528:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788572120.680536:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788572120.680690:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a75180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518350720:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788572120.680799:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf476033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572120.695475:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572120.695517:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495253120 00000100:00100000:2.0:1788572120.695526:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495253120 00000100:00100000:2.0:1788572120.695580:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:2.0:1788572120.695591:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:78708c10-ef63-4de2-8b1c-aff484c98227+46:10477:x1875453495253120:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788572120.695670:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:78708c10-ef63-4de2-8b1c-aff484c98227+46:10477:x1875453495253120:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572120.695678:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1788572120.696474:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a75180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518350720:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572120.705334:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.705605:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495253248 00000100:00100000:3.0:1788572120.705617:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495253248 00000100:00100000:3.0:1788572120.705678:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:3.0:1788572120.705690:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+45:10477:x1875453495253248:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788572120.705722:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788572120.705821:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+45:10477:x1875453495253248:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 132us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572120.705829:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:3.0:1788572120.722871:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572120.722964:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495253376 00000100:00100000:1.0:1788572120.722988:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495253376 00000100:00100000:1.0:1788572120.723066:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:1.0:1788572120.723076:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+45:10477:x1875453495253376:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788572120.723173:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723193:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723207:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723334:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723343:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723350:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723377:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723385:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723392:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572120.723454:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788572120.723458:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572120.723477:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723489:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723495:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723501:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723507:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572120.723512:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723519:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723533:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:1.0:1788572120.723536:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572120.723540:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723546:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffad8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723557:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723574:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723579:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723584:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572120.723587:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723594:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723602:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff88c058eac500) 00010000:00010000:1.0:1788572120.723604:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572120.723606:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723612:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffadf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723628:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723633:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723637:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723641:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572120.723651:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723657:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723664:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bf000) 00010000:00010000:1.0:1788572120.723667:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572120.723669:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.723675:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572120.723749:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+45:10477:x1875453495253376:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 673us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572120.723757:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:0.0:1788572120.729048:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.729184:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495253632 00000100:00100000:3.0:1788572120.729193:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495253632 00000100:00100000:3.0:1788572120.729285:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:3.0:1788572120.729296:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+45:10477:x1875453495253632:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572120.729315:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572120.729349:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffaed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f16 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729453:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729469:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729480:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572120.729492:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788572120.729585:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729593:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729599:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729605:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572120.729609:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729617:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729629:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bf000) 00010000:00010000:3.0:1788572120.729631:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572120.729636:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729653:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffaf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729696:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffaed lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f16 expref: 47 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729706:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:3.0:1788572120.729709:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572120.729712:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffaed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f16 expref: 47 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.729721:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387400, rc 0) 00000100:00100000:3.0:1788572120.729780:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+46:10477:x1875453495253632:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 487us (743us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788572120.729787:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:0.0:1788572120.744872:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572120.744991:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495253760 00000100:00100000:2.0:1788572120.745009:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495253760 00000100:00100000:2.0:1788572120.745071:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:2.0:1788572120.745081:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+46:10477:x1875453495253760:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788572120.745116:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788572120.745244:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+46:10477:x1875453495253760:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 164us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572120.745277:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:1.0:1788572120.754439:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572120.754514:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495254016 00000100:00100000:2.0:1788572120.754525:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495254016 00000100:00100000:2.0:1788572120.754584:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:2.0:1788572120.754594:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+46:10477:x1875453495254016:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572120.754614:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572120.754618:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788572120.754647:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffaae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f08 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.754663:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572120.754668:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572120.754680:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffb02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f1d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572120.755465:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788572120.755682:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffb09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.755697:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.755708:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.755771:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffb02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f1d expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.755803:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffb09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f1d expref: 47 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.755811:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572120.755814:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572120.755817:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d200, rc 0) 00000100:00100000:2.0:1788572120.755893:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+47:10477:x1875453495254016:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1300us (1460us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788572120.755902:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1788572120.762470:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572120.762536:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495254272 00000100:00100000:2.0:1788572120.762545:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495254272 00000100:00100000:2.0:1788572120.762597:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:2.0:1788572120.762607:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+47:10477:x1875453495254272:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788572120.762662:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572120.762686:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffb09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f1d expref: 47 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.762706:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572120.762717:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572120.762742:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.762756:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.762766:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.762790:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.762797:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.762803:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763073:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763082:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763088:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763094:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572120.763158:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763166:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763174:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572120.763177:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572120.763181:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763186:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffb17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763204:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763209:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763215:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763220:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572120.763223:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763229:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763237:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xbfca9203 (ffff88c0593ef200) 00010000:00010000:2.0:1788572120.763239:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572120.763242:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.763289:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbfca9203 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572120.763376:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+46:10477:x1875453495254272:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 768us (915us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572120.763384:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:0.0:1788572120.766553:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572120.766751:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495254400 00000100:00100000:2.0:1788572120.766762:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495254400 00000100:00100000:2.0:1788572120.766826:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:2.0:1788572120.766851:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+46:10477:x1875453495254400:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572120.766873:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572120.766897:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bffb25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f24 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.766946:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.766960:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.766980:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.767085:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969bffb25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f24 expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.767114:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f24 expref: 47 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572120.767123:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:2.0:1788572120.767126:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788572120.767130:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d000, rc 0) 00000100:00100000:2.0:1788572120.767200:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+47:10477:x1875453495254400:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 351us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572120.767207:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:0.0:1788572120.780197:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.780974:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495254656 00000100:00100000:3.0:1788572120.780986:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495254656 00000100:00100000:3.0:1788572120.781058:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:3.0:1788572120.781079:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+47:10477:x1875453495254656:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788572120.781174:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.781191:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.781204:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572120.781568:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788572120.781577:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341572328228ns, next at 342572326102ns, rc = 0 00000004:00010000:3.0:1788572120.781658:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fe74a5f reply state 0000000046ac2704 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572120.781667:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572120.781760:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+49:10477:x1875453495254656:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 682us (1571us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788572120.781768:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:1.0:1788572120.788647:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:1.0:1788572120.788709:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.788720:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.788728:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.788733:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572120.788738:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.788757:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.788775:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:1.0:1788572120.788779:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788572120.788784:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.788791:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffb33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572120.793974:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495254784 00000100:00100000:3.0:1788572120.793991:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495254784 00000100:00100000:3.0:1788572120.794206:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:3.0:1788572120.794218:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+48:10477:x1875453495254784:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572120.794241:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572120.794281:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f2b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.794350:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f2b expref: 49 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.794366:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f2b expref: 49 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.794387:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:3.0:1788572120.794391:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572120.794394:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387000, rc 0) 00000100:00100000:3.0:1788572120.794699:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+49:10477:x1875453495254784:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 482us (6057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572120.794716:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00010000:00010000:2.0:1788572120.809527:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572120.826475:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.833607:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495254912 00000100:00100000:3.0:1788572120.833627:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495254912 00000100:00100000:3.0:1788572120.833691:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:3.0:1788572120.833699:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875453495254912:12345-192.168.202.2@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788572120.833732:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:3.0:1788572120.833767:0:6679:0:(genops.c:1385:class_connect()) connect: client 78708c10-ef63-4de2-8b1c-aff484c98227, cookie 0x977d9e7969bffb41 00002000:00100000:3.0:1788572120.833779:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 78708c10-ef63-4de2-8b1c-aff484c98227/ffff88c04727f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788572120.833790:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788572120.834097:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788572120.834136:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88c04727d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572120.834208:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2352:x1875453495254912:12345-192.168.202.2@tcp:8:lhsmtool_posix.0 Request processed in 507us (7744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572120.834215:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:3.0:1788572120.843968:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.844020:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495255040 00000100:00100000:3.0:1788572120.844033:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495255040 00000100:00100000:3.0:1788572120.844091:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788572120.844102:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:0:x1875453495255040:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788572120.844405:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788572120.894360:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1788572120.894377:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000100:00100000:3.0:1788572120.894644:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+5:0:x1875453495255040:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 50537us (50682us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788572120.894655:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788572120.902175:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572120.902460:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495255296 00000100:00100000:2.0:1788572120.902472:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495255296 00000100:00100000:2.0:1788572120.902539:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788572120.902548:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+49:10477:x1875453495255296:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788572120.902796:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+50:10477:x1875453495255296:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 248us (631us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788572120.902805:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788572120.907868:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.908434:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495255552 00000100:00100000:3.0:1788572120.908448:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495255552 00000100:00100000:3.0:1788572120.908512:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:3.0:1788572120.908525:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+50:10477:x1875453495255552:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788572120.908657:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+50:10477:x1875453495255552:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 134us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572120.908665:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:1.0:1788572120.940739:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.941899:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495255680 00000100:00100000:3.0:1788572120.941914:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495255680 00000100:00100000:3.0:1788572120.942003:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:3.0:1788572120.942015:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+50:10477:x1875453495255680:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572120.942437:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572120.942464:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f32 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.942871:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.942885:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.942894:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572120.942942:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572120.942965:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.945371:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f32 expref: 52 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.945422:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f32 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.945435:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:3.0:1788572120.945438:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788572120.945443:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387a00, rc 0) 00000100:00100000:3.0:1788572120.945578:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+51:10477:x1875453495255680:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 3563us (4849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572120.945587:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:1.0:1788572120.952898:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.962630:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495255808 00000100:00100000:3.0:1788572120.962646:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495255808 00000100:00100000:3.0:1788572120.962728:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1788572120.962739:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495255808:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572120.962771:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572120.962800:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f39 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572120.962830:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b71d8, blocks: 0x1 00010000:00010000:3.0:1788572120.962852:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1788572120.962857:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572120.962865:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f39 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.962885:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f39 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.962913:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387400, rc 0) 00000100:00100000:3.0:1788572120.963487:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495255808:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 744us (10597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572120.963497:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:1.0:1788572120.973691:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.974875:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495256064 00000100:00100000:3.0:1788572120.974888:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495256064 00000100:00100000:3.0:1788572120.975001:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1788572120.975013:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+51:10477:x1875453495256064:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788572120.975128:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+51:10477:x1875453495256064:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 117us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572120.975136:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:2.0:1788572120.983775:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572120.984109:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495256192 00000100:00100000:1.0:1788572120.984120:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495256192 00000100:00100000:1.0:1788572120.984616:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:1.0:1788572120.984627:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:10477:x1875453495256192:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572120.984646:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572120.984669:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f40 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.984700:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f39 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.984709:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572120.984729:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572120.984735:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.985738:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f39 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572120.986299:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f39 expref: 7 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572120.986320:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518350848:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572120.986438:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572120.994338:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572120.994562:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518350848:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572120.994605:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572120.994629:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994000, rc 0) 00000100:00100000:3.0:1788572120.994688:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:10477:x1875453495256192:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 10063us (10926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572120.994699:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1788572120.995888:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495256320 00000100:00100000:0.0:1788572120.995903:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495256320 00010000:00010000:0.0:1788572120.995956:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f39 expref: 7 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572120.996012:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1788572120.996024:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058e7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495256320:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572120.996041:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572120.996067:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f39 expref: 7 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.996080:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f39 expref: 7 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.996118:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffb56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f39 expref: 7 pid: 6680 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.996145:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572120.996151:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572120.996160:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.996170:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572120.996229:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572120.996244:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1875453518350976:192.168.202.2@tcp:105: 00000100:00100000:0.0:1788572120.996343:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c058dc9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572121.022360:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572121.022536:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1875453518350976:192.168.202.2@tcp:105: 00010000:00010000:2.0:1788572121.022581:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572121.022659:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058e7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495256320:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 26636us (28330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572121.022670:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:1.0:1788572121.022672:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495256448 00000100:00100000:1.0:1788572121.022678:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495256448 00002000:00100000:1.0:1788572121.022720:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88c0764a6d80 x1875453495256448/t0(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:537/0 lens 504/0 e 0 to 0 dl 1788572132 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572121.022730:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c0764a6d80 with x1875453495256448 ext(0->8) 00002000:00010000:1.0:1788572121.022735:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c0764a6d80 00000100:00100000:1.0:1788572121.022766:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788572121.022776:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495256448:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788572121.023842:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495256448:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 1063us (1488us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788572121.023852:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00002000:00100000:1.0:1788572121.023861:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88c0764a6d80 x1875453495256448/t4294967302(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:537/0 lens 504/448 e 0 to 0 dl 1788572132 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572121.023877:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c0764a6d80 with x1875453495256448 ext(0->8) 00002000:00010000:1.0:1788572121.023882:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c0764a6d80 00000100:00100000:1.0:1788572121.029491:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572121.029563:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495256576 00000100:00100000:0.0:1788572121.029574:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495256576 00000100:00080000:3.0:1788572121.029638:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572121.029656:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:0.0:1788572121.029667:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+51:10477:x1875453495256576:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788572121.158275:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+51:10477:x1875453495256576:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 128581us (128764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572121.158289:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00000001:00080000:0.0:1788572121.158332:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:0.0:1788572121.158344:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788572121.158369:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1788572121.158400:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788572121.158411:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1788572121.158433:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c059bbdb40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788572121.158437:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07c307800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c046f7b480 00000020:00080000:0.0:1788572121.158440:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07c307300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c07f731c00 00000004:00080000:0.0:1788572121.158462:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1788572121.158486:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572121.158503:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518351104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572121.158555:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572121.158650:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518351104 00000100:00100000:0.0:1788572121.158659:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518351104 00000020:00080000:1.0:1788572121.158774:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1788572121.159131:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518351232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788572121.159168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572121.159213:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518351232 00000100:00100000:2.0:1788572121.159217:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518351232 00000100:00100000:0.0:1788572121.159651:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788572121.159661:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518351104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572121.159795:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788572121.159803:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518351232:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:0.0:1788572121.159839:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788572121.159869:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9b71d5, atime: 0x6a9b71d5, ctime: 0x6a9b71d5, blocks: 0x1 00010000:00010000:0.0:1788572121.159877:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.159894:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1788572121.159898:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572121.159904:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.159934:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.159945:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.159952:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572121.159959:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788572121.159962:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788572121 00002000:00010000:2.0:1788572121.159964:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788572121.159967:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788572120 -> 1788572121 00002000:00010000:2.0:1788572121.159969:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1788572121.159979:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572121.160030:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518351232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 227us (860us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788572121.160038:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788572121.160063:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572121.160067:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788572121.160098:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c0764a6300/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788572121.160103:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518351232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788572121.160514:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3297:x1875453518351104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 854us (1957us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788572121.160521:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788572121.160544:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572121.160550:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.160565:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572121.160570:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.160579:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.160596:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.160604:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969bffb64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.160623:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572121.160625:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572121.160627:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572121.160713:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88bf46a75f80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788572121.160719:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518351104:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1788572121.160794:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788572121.163306:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572121.163417:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495256704 00000100:00100000:2.0:1788572121.163427:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495256704 00000100:00100000:2.0:1788572121.163479:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1788572121.163490:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495256704:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788572121.294181:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495256704:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 130679us (130872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572121.294200:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000001:00080000:1.0:1788572121.294280:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788572121.294295:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788572121.310049:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572121.313290:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495256960 00000100:00100000:1.0:1788572121.313306:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495256960 00000100:00100000:1.0:1788572121.313372:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:1.0:1788572121.313382:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+13:10477:x1875453495256960:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788572121.313434:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572121.313460:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f32 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.313480:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:1.0:1788572121.313486:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572121.313514:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.313528:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.313537:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572121.313788:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000613334fd reply state 00000000e24133aa transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572121.313815:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572121.313932:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+14:10477:x1875453495256960:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 551us (3894us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788572121.313939:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000040:00080000:1.0:1788572121.323817:0:11997:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572121.323827:0:11997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572121.323868:0:11997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788572121.323873:0:11997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788572121.330828:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:3.0:1788572121.330864:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.330891:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.330898:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.330914:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572121.330921:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.330929:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.330947:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:3.0:1788572121.331011:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572121.331018:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.331024:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffb6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572121.331057:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495257088 00000100:00100000:3.0:1788572121.331069:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495257088 00000100:00100000:3.0:1788572121.331128:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1788572121.331203:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495257088:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788572121.331466:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788572121.331470:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788572121 -> 1788572119 00002000:00010000:3.0:1788572121.331473:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788572117 00002000:00010000:3.0:1788572121.331475:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788572121 -> 1788572119 00002000:00010000:3.0:1788572121.331485:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788572121.331542:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495257088:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 405us (723us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788572121.331550:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1788572121.336073:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572121.336370:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495257344 00000100:00100000:2.0:1788572121.336382:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495257344 00000100:00100000:2.0:1788572121.336480:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:2.0:1788572121.336491:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+13:10477:x1875453495257344:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788572121.336564:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.336581:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f24 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.336591:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.336641:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f24 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.336655:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f24 expref: 13 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572121.336670:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518351360:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572121.336760:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0503433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572121.341875:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572121.341875:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518351360:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572121.341917:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572121.341920:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495257472 00000100:00100000:3.0:1788572121.341925:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495257472 00010000:00010000:3.0:1788572121.341975:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f24 expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572121.342006:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1788572121.342015:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c364380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+14:2355:x1875453495257472:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572121.342029:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572121.342036:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f24 expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.342048:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f24 expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.342071:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffb2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f24 expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.342086:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:3.0:1788572121.342091:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.342112:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.342128:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.342165:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572121.342172:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.342179:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.342210:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572121.342214:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c364380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+13:2355:x1875453495257472:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 200us (351us total) trans 0 rc 0/0 00010000:00010000:2.0:1788572121.342217:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572121.342221:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00010000:00010000:2.0:1788572121.342224:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.342229:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572121.342234:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.343378:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.343405:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:2.0:1788572121.343408:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788572121.343413:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.343421:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffb72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572121.343507:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+12:10477:x1875453495257344:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 7016us (7444us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788572121.343516:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:3.0:1788572121.351832:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572121.352078:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495257600 00000100:00100000:0.0:1788572121.352092:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495257600 00000100:00100000:0.0:1788572121.352173:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:0.0:1788572121.352186:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495257600:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788572121.352244:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.352295:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.352312:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788572121.352317:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788572121.352321:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.352361:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.352377:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 7 pid: 6681 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572121.352399:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518351488:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572121.352531:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf47603d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572121.356476:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572121.356888:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518351488:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572121.356931:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572121.357028:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495257728 00000100:00100000:3.0:1788572121.357036:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495257728 00010000:00010000:3.0:1788572121.357074:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 8 pid: 6681 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572121.357401:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1788572121.357412:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495257728:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572121.357428:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572121.357451:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 8 pid: 6681 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.357464:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 8 pid: 6681 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.357503:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003257874f/0x977d9e7969bffb5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f40 expref: 8 pid: 6681 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.357517:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572121.357521:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572121.357526:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.357537:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.357572:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572121.357634:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495257728:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 223us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572121.357641:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00010000:00010000:2.0:1788572121.357697:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.357707:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.357733:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.357741:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.357750:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.357763:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572121.357768:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.357777:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.357792:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.357800:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f6191b2/0x977d9e7969bffb79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572121.357847:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495257600:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 5665us (6025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572121.357855:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:3.0:1788572121.363740:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572121.363776:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495257984 00000100:00100000:3.0:1788572121.363786:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495257984 00000100:00100000:3.0:1788572121.363835:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:3.0:1788572121.363845:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+12:10477:x1875453495257984:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788572121.363932:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.367307:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.367346:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.367675:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.367693:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f2b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.367702:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.367742:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f2b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.367759:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f2b expref: 13 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572121.367775:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c367b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518351616:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572121.367862:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04a1ae3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572121.371099:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c367b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518351616:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572121.371145:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572121.372113:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572121.372683:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495258112 00000100:00100000:0.0:1788572121.372694:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495258112 00010000:00010000:0.0:1788572121.372734:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f2b expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572121.374066:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:2.0:1788572121.374084:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c367480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+14:2355:x1875453495258112:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572121.374220:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572121.374233:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f2b expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.374359:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f2b expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.374394:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffb3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f2b expref: 14 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.374409:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:2.0:1788572121.374414:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.374544:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.374554:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.374647:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572121.374837:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c367480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+13:2355:x1875453495258112:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 757us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572121.374846:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00010000:00010000:0.0:1788572121.375263:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.375272:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572121.375464:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788572121.375602:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788572121.375649:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788572121.375751:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1875453518351744:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788572121.375814:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572121.375846:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c058dc9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572121.379481:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518351744 00000100:00100000:3.0:1788572121.379499:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518351744 00000100:00100000:3.0:1788572121.379565:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788572121.379575:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1875453518351744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788572121.379695:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1875453518351744:12345-0@lo:1000:mdt00_001.0 Request processed in 122us (3880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572121.379703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788572121.379748:0:5831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788572121.379753:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c0764a6300, transno 4294967303 00000100:00100000:3.0:1788572121.379775:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1875453518351744:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788572121.380708:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788572121.380798:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c367b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1875453518351872:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788572121.380851:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572121.380935:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf47603300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572121.390339:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518351872 00000100:00100000:0.0:1788572121.390357:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518351872 00000100:00100000:1.0:1788572121.390505:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788572121.390516:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1875453518351872:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788572121.390826:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1875453518351872:12345-0@lo:1000:mdt00_001.0 Request processed in 310us (9972us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788572121.390834:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788572121.390903:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c367b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5831:1875453518351872:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788572121.390958:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.390969:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.390976:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.390982:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572121.390987:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391006:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391023:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:1.0:1788572121.391026:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572121.391031:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391038:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffb87 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391078:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391085:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391092:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391097:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ac00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572121.391100:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391106:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391114:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bf000) 00010000:00010000:1.0:1788572121.391117:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572121.391120:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391136:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffab5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391171:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391185:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f0f expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391195:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391229:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f0f expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572121.391277:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f0f expref: 16 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572121.391294:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518352000:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572121.391379:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572121.400432:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572121.400621:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518352000:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572121.400652:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572121.400695:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495258240 00000100:00100000:0.0:1788572121.400702:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495258240 00010000:00010000:0.0:1788572121.400739:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f0f expref: 17 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572121.400769:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1788572121.400778:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+17:2356:x1875453495258240:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572121.400792:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572121.400799:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f0f expref: 17 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.400812:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f0f expref: 17 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.400833:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f0f expref: 17 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.400862:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bf000) 00010000:00010000:0.0:1788572121.400868:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.400878:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.400887:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.400922:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572121.400975:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+16:2356:x1875453495258240:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 198us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572121.400983:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00010000:00010000:0.0:1788572121.401007:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401015:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401026:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401033:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401038:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401043:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572121.401055:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401063:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401072:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bf000) 00010000:00010000:0.0:1788572121.401075:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572121.401078:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401084:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffb8e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401094:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401113:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401118:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401124:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572121.401126:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401284:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401292:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bf000) 00010000:00010000:0.0:1788572121.401294:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788572121.401304:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572121.401309:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bffb80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572121.401524:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+15:10477:x1875453495257984:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 37679us (37789us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788572121.401533:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000020:00080000:0.0:1788572121.401537:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788572121.404316:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788572121.404326:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788572121.404379:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788572121.404385:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788572121.407081:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572121.407360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495258496 00000100:00100000:3.0:1788572121.407372:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495258496 00000100:00100000:3.0:1788572121.407431:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1788572121.407442:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+15:10477:x1875453495258496:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788572121.408199:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788572121.408336:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788572121.408388:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.408406:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.408418:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.408427:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.408435:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.408441:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572121.408487:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572121.408579:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+17:10477:x1875453495258496:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1136us (1507us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788572121.408588:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000020:00080000:3.0:1788572121.408594:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572121.408665:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572121.408673:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.408680:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572121.408684:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.408692:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.408706:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572121.408715:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572121.408720:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.408726:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffb95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572121.408746:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572121.408748:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572121.408749:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572121.832419:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788572122.845170:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1788572122.845190:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1788572122.856536:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572123.489426:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788572123.489437:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572123.491884:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788572123.491897:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788572123.706992:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572123.707132:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495258752 00000100:00100000:1.0:1788572123.707143:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495258752 00000100:00100000:1.0:1788572123.707231:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:1.0:1788572123.707241:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+17:10496:x1875453495258752:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572123.707289:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572123.707314:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969bffb9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f47 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.707437:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bffba3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.707451:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bffba3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.707466:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bffba3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572123.707478:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00080000:3.0:1788572123.707585:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572123.707597:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969bffb9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f47 expref: 20 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.707617:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bffba3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f47 expref: 19 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.707625:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:1.0:1788572123.707628:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788572123.707632:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994c00, rc 0) 00000100:00100000:1.0:1788572123.707698:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+19:10496:x1875453495258752:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 458us (715us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788572123.707706:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:3.0:1788572123.710995:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572123.714012:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495258880 00000100:00100000:0.0:1788572123.714028:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495258880 00000100:00100000:0.0:1788572123.714093:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:0.0:1788572123.714104:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+19:10496:x1875453495258880:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1788572123.714195:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714212:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714225:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714240:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714281:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714288:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714515:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714524:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714532:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572123.714575:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714587:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714593:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714600:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714606:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024aa00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572123.714610:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714619:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714638:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:0.0:1788572123.714641:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572123.714645:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714651:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714670:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714676:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714681:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714686:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572123.714689:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714695:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714717:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0481bfc00) 00010000:00010000:0.0:1788572123.714720:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572123.714722:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714728:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714757:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714763:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714769:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714775:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572123.714777:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714782:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714790:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bf000) 00010000:00010000:0.0:1788572123.714792:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572123.714795:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.714802:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572123.714911:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+19:10496:x1875453495258880:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 807us (3921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572123.714920:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:3.0:1788572123.770029:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572123.770341:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495259136 00000100:00100000:0.0:1788572123.770351:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495259136 00000100:00100000:0.0:1788572123.770399:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:0.0:1788572123.770414:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+19:10499:x1875453495259136:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572123.770432:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572123.770451:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f4e expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.770510:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.770521:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.770530:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.770540:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.770545:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.770549:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774396:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774414:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774423:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572123.774441:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788572123.774531:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774537:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774541:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774545:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572123.774548:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774553:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774561:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:0.0:1788572123.774563:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572123.774566:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774571:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffbcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774584:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774587:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774597:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774601:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024aa00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572123.774603:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774606:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774610:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0481bf000) 00010000:00010000:0.0:1788572123.774612:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572123.774614:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774617:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774666:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f4e expref: 22 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774681:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f4e expref: 21 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.774688:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:0.0:1788572123.774690:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572123.774693:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b200, rc 0) 00000100:00100000:0.0:1788572123.774770:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+21:10499:x1875453495259136:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 4354us (4749us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788572123.774786:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1788572123.783306:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572123.783456:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495259264 00000100:00100000:0.0:1788572123.783467:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495259264 00000100:00100000:0.0:1788572123.783546:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:0.0:1788572123.783558:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+21:10499:x1875453495259264:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:0.0:1788572123.783627:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.783647:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.783659:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.783685:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.783691:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.783698:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.783704:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572123.783708:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.783717:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.783727:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:0.0:1788572123.783746:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572123.783753:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.783760:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572123.783859:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+21:10499:x1875453495259264:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 302us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572123.783867:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:3.0:1788572123.787420:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572123.789406:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495259520 00000100:00100000:1.0:1788572123.789419:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495259520 00000100:00100000:1.0:1788572123.789481:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:1.0:1788572123.789492:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c06bdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+21:10499:x1875453495259520:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572123.789747:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c06bdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+22:10499:x1875453495259520:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 256us (2332us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788572123.789764:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788572123.838722:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572123.838909:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495259776 00000100:00100000:0.0:1788572123.838921:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495259776 00000100:00100000:0.0:1788572123.838986:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:0.0:1788572123.838997:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+22:10019:x1875453495259776:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572123.839021:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572123.839043:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbf0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f55 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.839168:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.839183:0:10431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f4e expref: 23 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.839192:0:10431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.839226:0:10431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f4e expref: 23 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.839296:0:10431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f4e expref: 23 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572123.839310:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518352128:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572123.839419:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572123.856514:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572123.856662:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495259904 00000100:00100000:3.0:1788572123.856672:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495259904 00010000:00010000:3.0:1788572123.856714:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f4e expref: 24 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572123.856754:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:3.0:1788572123.856763:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+24:2356:x1875453495259904:12345-192.168.202.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788572123.856774:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518352128:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572123.856777:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572123.856782:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f4e expref: 24 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572123.856794:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f4e expref: 24 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.860976:0:10431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572123.862063:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffbdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f4e expref: 24 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572123.862126:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:3.0:1788572123.862132:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572123.862142:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572123.862149:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.862383:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572123.862461:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+23:2356:x1875453495259904:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 5697us (5954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572123.862471:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00010000:00010000:2.0:1788572123.862564:0:10431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.862573:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572123.862595:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788572123.862770:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffbf0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f55 expref: 24 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.862789:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f55 expref: 23 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.862797:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572123.862799:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572123.862802:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024aa00, rc 0) 00000100:00100000:2.0:1788572123.862850:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+23:10019:x1875453495259776:12345-192.168.202.2@tcp:101:bash.0 Request processed in 23855us (24139us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788572123.862858:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:3.0:1788572123.874533:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572123.877485:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495260160 00000100:00100000:0.0:1788572123.877504:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495260160 00000100:00100000:0.0:1788572123.877642:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:0.0:1788572123.877654:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+23:10019:x1875453495260160:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:0.0:1788572123.877979:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.877999:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.878012:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572123.878087:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788572123.879616:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055640d56 reply state 0000000077cf81af transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572123.879636:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788572123.879785:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788572123.879944:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+27:10019:x1875453495260160:12345-192.168.202.2@tcp:36:bash.0 Request processed in 2289us (5419us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788572123.879955:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000020:00080000:0.0:1788572123.879962:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788572123.881159:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572123.882178:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.882196:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.882204:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.882210:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572123.882215:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.882223:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.882242:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:1.0:1788572123.882262:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572123.882269:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572123.882275:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffc05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572123.884164:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572123.884308:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495260288 00000100:00100000:2.0:1788572123.884321:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495260288 00000100:00100000:2.0:1788572123.884400:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:2.0:1788572123.884412:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+26:10019:x1875453495260288:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572123.884437:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572123.884458:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffc0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f5c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.884520:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffc0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f5c expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.884536:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffc0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f5c expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.884555:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572123.884558:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572123.884562:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c400, rc 0) 00000100:00100000:2.0:1788572123.884619:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+27:10019:x1875453495260288:12345-192.168.202.2@tcp:101:bash.0 Request processed in 209us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572123.884637:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:3.0:1788572123.887444:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572123.887581:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495260416 00000100:00100000:0.0:1788572123.887592:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495260416 00000100:00100000:0.0:1788572123.887679:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:0.0:1788572123.887690:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:10019:x1875453495260416:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572123.887706:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572123.887728:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f63 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572123.887755:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b71d7, atime: 0x6a9b71d5, ctime: 0x6a9b71d7, blocks: 0xb 00010000:00010000:0.0:1788572123.887783:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1788572123.887788:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572123.887798:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f63 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788572123.887812:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788572123.887815:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f63 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572123.887828:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ae00, rc 0) 00000100:00100000:0.0:1788572123.887900:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:10019:x1875453495260416:12345-192.168.202.2@tcp:101:bash.0 Request processed in 212us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572123.887921:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:1.0:1788572123.891436:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572123.891879:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495260544 00000100:00100000:3.0:1788572123.891959:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495260544 00002000:00010000:3.0:1788572123.892004:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788572123.892009:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07c34ce00 with x1875453495260544 ext(0->18446744073709551615) 00002000:00010000:3.0:1788572123.892022:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c07c34ce00. 00000100:00100000:3.0:1788572123.892122:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:3.0:1788572123.892135:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495260544:12345-192.168.202.2@tcp:10:bash.0 00002000:00010000:3.0:1788572123.892612:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788572123.892616:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788572119 -> 1788572123 00002000:00010000:3.0:1788572123.892619:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788572117 -> 1788572117 00002000:00010000:3.0:1788572123.892621:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788572119 -> 1788572123 00002000:00010000:3.0:1788572123.892826:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788572123.892977:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495260544:12345-192.168.202.2@tcp:10:bash.0 Request processed in 843us (1549us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788572123.893000:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00002000:00010000:3.0:1788572123.893006:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788572123.893008:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07c34ce00 with x1875453495260544 ext(0->18446744073709551615) 00002000:00010000:3.0:1788572123.893015:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c07c34ce00. 00000100:00100000:3.0:1788572123.971309:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572123.971556:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495260672 00000100:00100000:2.0:1788572123.971568:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495260672 00000100:00100000:2.0:1788572123.971621:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:2.0:1788572123.971632:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+27:10513:x1875453495260672:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:2.0:1788572123.971740:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.971760:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.971773:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.971791:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.971799:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.971805:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972089:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972099:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972107:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572123.972161:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972174:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972190:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972196:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972202:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572123.972206:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972215:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972227:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572123.972230:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572123.972235:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972241:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972309:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972316:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972321:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972325:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0de00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572123.972335:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972342:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972350:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0593ef300) 00010000:00010000:2.0:1788572123.972352:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572123.972355:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972361:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972376:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972382:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972387:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972392:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572123.972395:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972400:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972406:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572123.972408:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572123.972418:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572123.972423:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572123.972751:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+27:10513:x1875453495260672:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 1117us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572123.972761:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:0.0:1788572124.048991:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572124.049136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495260928 00000100:00100000:2.0:1788572124.049148:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495260928 00000100:00100000:2.0:1788572124.049209:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:2.0:1788572124.049219:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+27:10516:x1875453495260928:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572124.049240:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572124.049290:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049364:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049378:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049388:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049403:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049411:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049445:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049717:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bffc44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049727:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bffc44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049734:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bffc44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572124.049744:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788572124.049862:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049870:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049877:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049883:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0de00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572124.049889:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049897:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049910:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572124.049913:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572124.049933:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049940:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049955:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049960:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049965:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049970:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572124.049973:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049978:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049985:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0593ef300) 00010000:00010000:2.0:1788572124.049988:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572124.049990:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.049995:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.050037:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f6a expref: 30 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.050063:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bffc44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f6a expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.050070:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572124.050072:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788572124.050075:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c200, rc 0) 00000100:00100000:2.0:1788572124.050143:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+29:10516:x1875453495260928:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 926us (1162us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788572124.050150:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:1.0:1788572124.057349:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572124.057550:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495261056 00000100:00100000:2.0:1788572124.057560:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495261056 00000100:00100000:2.0:1788572124.057687:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:2.0:1788572124.057698:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+29:10516:x1875453495261056:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:2.0:1788572124.057768:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.057785:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f55 expref: 29 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.057794:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.057827:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f55 expref: 29 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.057851:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f55 expref: 29 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572124.057878:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518352256:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572124.058043:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572124.063152:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572124.063929:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495261312 00000100:00100000:1.0:1788572124.063940:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495261312 00000100:00100000:1.0:1788572124.064012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:1.0:1788572124.064043:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+30:5594:x1875453495261312:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788572124.064458:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+31:5594:x1875453495261312:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 416us (1314us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788572124.064465:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:2.0:1788572124.066759:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518352256:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572124.066791:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572124.068525:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572124.068824:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495261440 00000100:00100000:0.0:1788572124.068847:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495261440 00010000:00010000:0.0:1788572124.068891:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f55 expref: 31 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572124.068936:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1788572124.068946:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+31:2355:x1875453495261440:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572124.068963:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572124.068969:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f55 expref: 31 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.068983:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f55 expref: 31 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.069008:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffbf7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f55 expref: 31 pid: 10431 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.069032:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:0.0:1788572124.069039:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.069049:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.069067:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.069114:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572124.069189:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+30:2355:x1875453495261440:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 244us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572124.069199:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00010000:00010000:2.0:1788572124.069205:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.069217:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.069284:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.069292:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.069299:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.069305:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572124.069309:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.069317:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.069327:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572124.069337:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572124.069341:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.069348:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572124.069392:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+29:10516:x1875453495261056:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 11696us (12264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.069402:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:1.0:1788572124.073442:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572124.074035:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495261696 00000100:00100000:2.0:1788572124.074046:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495261696 00000100:00100000:2.0:1788572124.074092:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1788572124.074102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+29:10516:x1875453495261696:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572124.074390:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+30:10516:x1875453495261696:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 288us (958us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788572124.074398:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:1.0:1788572124.208616:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572124.208744:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495261952 00000100:00100000:2.0:1788572124.208755:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495261952 00000100:00100000:2.0:1788572124.208820:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1788572124.208865:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+30:10527:x1875453495261952:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:2.0:1788572124.208902:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572124.208924:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f71 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209009:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209024:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209078:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209095:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209102:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209108:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209466:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bffc6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209477:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bffc6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209492:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bffc6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572124.209503:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788572124.209607:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209614:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209619:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209625:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572124.209635:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209641:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209653:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572124.209655:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572124.209659:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209665:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffc60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209676:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209681:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209685:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209689:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0de00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572124.209692:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209697:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209702:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0593ef300) 00010000:00010000:2.0:1788572124.209704:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572124.209711:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209717:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bffc67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209762:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969bffc59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f71 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209777:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bffc6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f71 expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.209783:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572124.209785:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572124.209787:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c000, rc 0) 00000100:00100000:2.0:1788572124.209865:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+32:10527:x1875453495261952:12345-192.168.202.2@tcp:101:cat.0 Request processed in 1002us (1257us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788572124.209872:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1788572124.217360:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572124.217519:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495262208 00000100:00100000:1.0:1788572124.217531:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495262208 00000100:00100000:1.0:1788572124.217599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:1.0:1788572124.217609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+32:10527:x1875453495262208:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:1.0:1788572124.217874:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+33:10527:x1875453495262208:12345-192.168.202.2@tcp:35:cat.0 Request processed in 265us (533us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788572124.217882:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:1.0:1788572124.252733:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572124.252848:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495262464 00000100:00100000:0.0:1788572124.252860:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495262464 00000100:00100000:0.0:1788572124.252934:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:0.0:1788572124.252946:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+33:10528:x1875453495262464:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:0.0:1788572124.253014:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788572124.253065:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969bffc6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f71 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253092:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969bffc44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f6a expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253103:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969bffc0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f5c expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253113:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:0.0:1788572124.253124:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572124.253157:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253172:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253182:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253217:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253225:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253232:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253571:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253580:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.253588:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572124.254166:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788572124.254178:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345044928893ns, next at 346044926023ns, rc = 0 00010000:00010000:0.0:1788572124.254240:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254284:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254293:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254301:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254317:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254324:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254356:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572124.254377:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254383:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254389:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254395:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024be00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572124.254399:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254407:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254417:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfa00) 00010000:00010000:0.0:1788572124.254420:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572124.254424:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254431:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffc8a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254452:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254463:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254468:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254473:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024aa00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572124.254476:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254482:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254489:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:0.0:1788572124.254492:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572124.254495:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.254501:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572124.254511:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000775c9bb0 reply state 000000005c75c94d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572124.254519:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572124.254603:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+32:10528:x1875453495262464:12345-192.168.202.2@tcp:36:rm.0 Request processed in 1656us (1878us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788572124.254612:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00010000:00010000:3.0:1788572124.254875:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572124.254882:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.254888:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024bc00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572124.254891:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.254897:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.254906:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88c0481bfa00) 00010000:00010000:3.0:1788572124.254908:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572124.254911:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.254916:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969bffc91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.254932:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572124.254934:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572124.254936:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572124.258004:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.258042:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.258061:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.258067:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572124.258072:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.258080:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.258097:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0481bf100) 00010000:00010000:0.0:1788572124.258100:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572124.258105:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.258112:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572124.264646:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518352512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572124.264735:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572124.264797:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518353024:0@lo:400:kworker.0 00000100:00100000:3.0:1788572124.264835:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572124.264883:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572124.264890:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518352640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572124.264914:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572124.264953:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518353024 00000100:00100000:3.0:1788572124.264961:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518353024 00000100:00100000:3.0:1788572124.265020:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788572124.265030:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518353024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572124.265099:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518353024:12345-0@lo:400:kworker.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572124.265107:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788572124.265140:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572124.265169:0:3297:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788572124.265179:0:3297:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788572124.265200:0:3297:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88bf46a75f80, transno 4294967301 00000100:00100000:3.0:1788572124.265216:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518353024:0@lo:400:kworker.0 00000100:00100000:3.0:1788572124.265472:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518352512 00000100:00100000:3.0:1788572124.265476:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518352512 00000100:00100000:3.0:1788572124.265498:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518352640 00000100:00100000:3.0:1788572124.265501:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518352640 00000100:00100000:3.0:1788572124.265526:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788572124.265533:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518352512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572124.265572:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518352512:12345-0@lo:400:kworker.0 Request processed in 39us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572124.265596:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788572124.265611:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788572124.265616:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518352640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572124.265647:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518352640:12345-0@lo:400:kworker.0 Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572124.265654:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788572124.265669:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572124.265687:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518352640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572124.265697:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518352512:0@lo:400:kworker.0 00000100:00100000:2.0:1788572124.266285:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518352768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572124.266329:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572124.266364:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572124.266370:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518352384:0@lo:400:kworker.0 00000100:00100000:2.0:1788572124.266396:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572124.266424:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518352896:0@lo:400:kworker.0 00000100:00100000:2.0:1788572124.266446:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572124.266470:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518352768 00000100:00100000:2.0:1788572124.266475:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518352768 00000100:00100000:2.0:1788572124.266523:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788572124.266530:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518352768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572124.266570:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518352768:12345-0@lo:400:kworker.0 Request processed in 41us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.266577:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788572124.266598:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518352384 00000100:00100000:2.0:1788572124.266601:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518352384 00000100:00100000:2.0:1788572124.266625:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788572124.266631:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518352384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572124.266660:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518352384:12345-0@lo:400:kworker.0 Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.266667:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:2.0:1788572124.266709:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572124.266727:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518352384:0@lo:400:kworker.0 00000100:00100000:2.0:1788572124.266739:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518352768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572124.267173:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518352896 00000100:00100000:0.0:1788572124.267179:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518352896 00000100:00100000:0.0:1788572124.267215:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788572124.267223:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518352896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572124.267286:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518352896:12345-0@lo:400:kworker.0 Request processed in 64us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572124.267293:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1788572124.267662:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572124.267704:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518352896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572124.349570:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572124.350092:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495262720 00000100:00100000:0.0:1788572124.350116:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495262720 00000100:00100000:0.0:1788572124.350193:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:0.0:1788572124.350204:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+31:10534:x1875453495262720:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572124.350231:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572124.350300:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.350633:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.350648:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.350661:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.350675:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.350811:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.350833:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572124.354013:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788572124.354485:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354502:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354533:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354573:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354580:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354586:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354591:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024aa00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572124.354595:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354602:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354615:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:0.0:1788572124.354617:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572124.354622:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354627:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffc9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572124.354650:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009457762b reply state 0000000000f35144 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572124.354658:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572124.354847:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffc98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f78 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354934:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f78 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.354943:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:0.0:1788572124.354945:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572124.354947:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b600, rc 0) 00000100:00100000:0.0:1788572124.355119:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+34:10534:x1875453495262720:12345-192.168.202.2@tcp:101:bash.0 Request processed in 4914us (5559us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788572124.355128:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:1.0:1788572124.361703:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:2.0:1788572124.361850:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.361864:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.361882:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.361888:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024be00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572124.361906:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.361914:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.361931:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0481bf100) 00010000:00010000:2.0:1788572124.361934:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572124.361940:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.361947:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffca6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572124.362808:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495262848 00000100:00100000:3.0:1788572124.362832:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495262848 00000100:00100000:3.0:1788572124.362923:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:3.0:1788572124.362934:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495262848:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788572124.362951:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572124.362971:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f7f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572124.362997:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572124.363015:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788572124.363020:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572124.363029:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f7f expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572124.363216:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572124.363295:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f7f expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.363327:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387200, rc 0) 00000100:00100000:3.0:1788572124.363591:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495262848:12345-192.168.202.2@tcp:101:bash.0 Request processed in 658us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572124.363599:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:2.0:1788572124.367235:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572124.367360:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495262976 00000100:00100000:0.0:1788572124.367370:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495262976 00000100:00100000:0.0:1788572124.367428:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1788572124.367437:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:10534:x1875453495262976:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572124.367454:0:11678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572124.367472:0:11678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f86 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.367501:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f7f expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.367510:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572124.367514:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572124.367519:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 7 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.367573:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f7f expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.367586:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f7f expref: 7 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572124.367600:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11678:1875453518353152:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572124.367702:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572124.372035:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572124.372213:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11678:1875453518353152:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572124.372284:0:11678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 7 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.372306:0:11678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b000, rc 0) 00000100:00100000:0.0:1788572124.372374:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:10534:x1875453495262976:12345-192.168.202.2@tcp:101:bash.0 Request processed in 4937us (5150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572124.372384:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1788572124.372998:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495263104 00000100:00100000:2.0:1788572124.373007:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495263104 00010000:00010000:2.0:1788572124.373041:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f7f expref: 7 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572124.373088:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788572124.373097:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495263104:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572124.373112:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572124.373134:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f7f expref: 7 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.373147:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f7f expref: 7 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.373189:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001da306fe/0x977d9e7969bffcbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f7f expref: 7 pid: 6680 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.373204:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572124.373209:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572124.373216:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.373226:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.373298:0:11167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572124.373313:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11167:1875453518353280:192.168.202.2@tcp:105: 00000100:00100000:2.0:1788572124.373397:0:11167:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572124.377055:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572124.377236:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495263360 00000100:00100000:3.0:1788572124.377245:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495263360 00000100:00100000:3.0:1788572124.377314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788572124.377321:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+33:10534:x1875453495263360:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:3.0:1788572124.377603:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+34:10534:x1875453495263360:12345-192.168.202.2@tcp:35:bash.0 Request processed in 282us (564us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788572124.377609:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:2.0:1788572124.379561:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11167:1875453518353280:192.168.202.2@tcp:105: 00010000:00010000:2.0:1788572124.379584:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572124.379636:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495263104:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 6540us (7615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.379644:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:1.0:1788572124.505569:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572124.505668:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572124.505876:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495263744 00000100:00100000:0.0:1788572124.505886:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495263744 00000100:00100000:0.0:1788572124.505951:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:0.0:1788572124.505960:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495263744:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572124.506042:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495263744:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 83us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572124.506050:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:1.0:1788572124.506539:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572124.506585:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572124.506701:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572124.506735:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495263872 00000100:00100000:1.0:1788572124.506741:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495263872 00000100:00100000:1.0:1788572124.506775:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:1.0:1788572124.506784:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495263872:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572124.506848:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495263872:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 66us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572124.506855:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:3.0:1788572124.508696:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495263488 00000100:00100000:3.0:1788572124.509280:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495263488 00000100:00100000:3.0:1788572124.509363:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 292 00000100:00100000:3.0:1788572124.509375:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495263488:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572124.509479:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495263488:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 106us (3920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572124.509486:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 292 00000100:00100000:2.0:1788572124.516905:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495264000 00000100:00100000:2.0:1788572124.516920:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495264000 00000100:00100000:2.0:1788572124.516998:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495263616 00000100:00100000:2.0:1788572124.517018:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495263616 00000100:00100000:2.0:1788572124.517065:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00100000:2.0:1788572124.517076:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495264000:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572124.517158:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495264000:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 85us (10621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.517166:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00100000:2.0:1788572124.517184:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 148 00000100:00100000:2.0:1788572124.517190:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+34:2356:x1875453495263616:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572124.517217:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+34:2356:x1875453495263616:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 28us (10631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.517223:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 148 00000100:00080000:1.0:1788572124.518597:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572124.646354:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572124.646578:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495264128 00000100:00100000:2.0:1788572124.646589:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495264128 00000100:00100000:2.0:1788572124.646718:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:2.0:1788572124.646729:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+34:10550:x1875453495264128:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572124.646751:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572124.646774:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bffcc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f8d expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.646868:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffcd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.646883:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.646895:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572124.646954:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788572124.646957:0:10431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572124.646975:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.646998:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bffcc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f8d expref: 36 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.647017:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffcd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f8d expref: 35 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.647027:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572124.647030:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572124.647035:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572124.647107:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+35:10550:x1875453495264128:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 380us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.647115:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:3.0:1788572124.654127:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572124.663790:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495264384 00000100:00100000:0.0:1788572124.663805:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495264384 00000100:00100000:0.0:1788572124.663924:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:0.0:1788572124.663934:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+35:10550:x1875453495264384:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572124.663953:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572124.663972:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffcd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f94 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.664072:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffcde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.664086:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffcde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.664098:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffcde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572124.664108:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788572124.664233:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffcd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f94 expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.664282:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffcde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f94 expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.664290:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:0.0:1788572124.664293:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572124.664296:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b400, rc 0) 00000100:00100000:0.0:1788572124.664370:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+37:10550:x1875453495264384:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 437us (10253us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788572124.664395:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:3.0:1788572124.669729:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572124.669772:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572124.670494:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495264640 00000100:00100000:0.0:1788572124.670516:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495264640 00000100:00100000:0.0:1788572124.670576:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:0.0:1788572124.670585:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+37:10550:x1875453495264640:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572124.670609:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572124.670629:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffcec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10f9b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.670728:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bffcf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.670743:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bffcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.670754:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bffcf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572124.670766:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788572124.670905:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffcec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f9b expref: 40 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.670929:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bffcf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f9b expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.670938:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:0.0:1788572124.670941:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788572124.670944:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a400, rc 0) 00000100:00100000:0.0:1788572124.671015:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+39:10550:x1875453495264640:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 430us (1296us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788572124.671022:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:2.0:1788572124.671354:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495264768 00000100:00100000:2.0:1788572124.671361:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495264768 00000100:00100000:2.0:1788572124.671405:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:2.0:1788572124.671413:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+39:2356:x1875453495264768:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572124.671425:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572124.671439:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffcde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f94 expref: 39 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.671455:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572124.671468:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572124.671491:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+38:2356:x1875453495264768:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 79us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.671498:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:0.0:1788572124.679088:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572124.679178:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495264896 00000100:00100000:2.0:1788572124.679190:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495264896 00000100:00100000:2.0:1788572124.679290:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:2.0:1788572124.679301:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495264896:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:2.0:1788572124.679361:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.679378:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.679387:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572124.679391:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572124.679396:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.679429:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.679444:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 6 pid: 11678 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572124.679458:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1875453518353408:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572124.679558:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0512113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572124.683499:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572124.683666:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495265024 00000100:00100000:1.0:1788572124.683675:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495265024 00002000:00100000:1.0:1788572124.683737:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88c07676e300 x1875453495265024/t0(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:540/0 lens 504/0 e 0 to 0 dl 1788572135 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572124.683748:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07676e300 with x1875453495265024 ext(0->8) 00010000:00010000:1.0:1788572124.683757:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 7 pid: 11678 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572124.683775:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 7 pid: 11678 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572124.683783:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88c07676e300 00000100:00100000:1.0:1788572124.683829:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1788572124.683840:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495265024:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:1.0:1788572124.684810:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495265024:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 967us (1475us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788572124.684832:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00002000:00100000:1.0:1788572124.684841:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88c07676e300 x1875453495265024/t4294967302(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:540/0 lens 504/448 e 0 to 0 dl 1788572135 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572124.684851:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07676e300 with x1875453495265024 ext(0->8) 00010000:00010000:1.0:1788572124.684866:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 9 pid: 11678 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572124.684880:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 9 pid: 11678 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572124.684888:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88c07676e300 00000100:00100000:2.0:1788572124.685233:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1875453518353408:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572124.685286:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572124.694805:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572124.695023:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495265152 00000100:00100000:3.0:1788572124.695035:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495265152 00010000:00010000:3.0:1788572124.695093:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 9 pid: 11678 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572124.695140:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:3.0:1788572124.695152:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:2353:x1875453495265152:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572124.695169:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788572124.695189:0:5815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788572124.695192:0:5815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788572124 00002000:00010000:3.0:1788572124.695194:0:5815:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788572124 00002000:00010000:3.0:1788572124.695197:0:5815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788572124 00010000:00010000:3.0:1788572124.695203:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 9 pid: 11678 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.695218:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 9 pid: 11678 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.695242:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0e1b6fe/0x977d9e7969bffcc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f86 expref: 9 pid: 11678 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.695298:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572124.695302:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572124.695307:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.695318:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.695441:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572124.695722:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+8:2353:x1875453495265152:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 570us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572124.695731:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00010000:00010000:0.0:1788572124.697090:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.697109:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.697144:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.697152:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.697160:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.697166:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ca00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572124.697171:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.697181:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.697218:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572124.697227:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ec90955/0x977d9e7969bffd01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572124.697357:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495264896:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 18056us (18280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572124.697367:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:0.0:1788572124.708473:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572124.708633:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495265408 00000100:00100000:3.0:1788572124.708645:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495265408 00000100:00100000:3.0:1788572124.708722:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1788572124.708732:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050315050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+38:10550:x1875453495265408:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:3.0:1788572124.708801:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bffcf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f9b expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572124.709111:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788572124.709168:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788572124.709593:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788572124.709651:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.709667:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f78 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.709676:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.709712:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f78 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.709727:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f78 expref: 42 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572124.709750:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1875453518353536:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572124.709867:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c067650780 going to sleep for 11 seconds 00000100:00100000:1.0:1788572124.724634:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572124.724787:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495265536 00000100:00100000:2.0:1788572124.724797:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495265536 00010000:00010000:2.0:1788572124.724850:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f78 expref: 43 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572124.724884:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:2.0:1788572124.724894:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+43:2356:x1875453495265536:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572124.724910:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572124.724917:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f78 expref: 43 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.724931:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f78 expref: 43 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.724956:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572124.724962:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.724972:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.724980:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.724999:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572124.725078:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+43:2356:x1875453495265536:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 186us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.725086:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00010000:00010000:3.0:1788572124.725803:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffcad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f78 expref: 42 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572124.725839:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1875453518353536:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572124.725907:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.725917:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.725924:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572124.726038:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788572124.726234:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788572124.726422:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518353664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788572124.726469:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572124.726493:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0503433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572124.727697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518353664 00000100:00100000:1.0:1788572124.727710:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518353664 00000100:00100000:1.0:1788572124.727786:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572124.727798:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875453518353664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788572124.727925:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875453518353664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 129us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572124.727933:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788572124.728105:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518353664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788572124.728946:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788572124.729036:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518353792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788572124.729090:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572124.729115:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572124.729669:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518353792 00000100:00100000:3.0:1788572124.729677:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518353792 00000100:00100000:3.0:1788572124.729715:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572124.729724:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875453518353792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788572124.729984:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1875453518353792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 261us (893us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788572124.730006:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788572124.731997:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518353792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788572124.732095:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788572124.732157:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.732167:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.732176:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.732181:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572124.732186:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.732193:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.732208:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572124.732210:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788572124.732215:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.732236:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bffd08 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572124.734797:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788572124.734956:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788572124.734969:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345525719354ns, next at 346525716552ns, rc = 0 00000001:00080000:2.0:1788572124.734976:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788572124.735023:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:2.0:1788572124.735027:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788572124.735037:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bffcf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f9b expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572124.735286:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050315050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+45:10550:x1875453495265408:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 26553us (26820us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788572124.735297:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000020:00080000:2.0:1788572124.735304:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788572124.747617:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572124.747748:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495265664 00000100:00100000:2.0:1788572124.747759:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495265664 00000100:00100000:2.0:1788572124.747829:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:2.0:1788572124.747839:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+45:10550:x1875453495265664:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572124.747862:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572124.747887:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffd0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fa2 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.747946:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffd0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fa2 expref: 46 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.747982:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffd0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fa2 expref: 46 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572124.748001:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572124.748004:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572124.748007:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d400, rc 0) 00000100:00100000:2.0:1788572124.748070:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+46:10550:x1875453495265664:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 232us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572124.748076:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:0.0:1788572124.761860:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572124.765864:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495265920 00000100:00100000:1.0:1788572124.765884:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495265920 00000100:00100000:1.0:1788572124.765965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:1.0:1788572124.765976:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+46:10550:x1875453495265920:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572124.766301:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+47:10550:x1875453495265920:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 325us (4450us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788572124.766309:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:3.0:1788572124.776737:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572124.776782:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518353920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572124.776888:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572124.776952:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518353920 00000100:00100000:0.0:1788572124.776962:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518353920 00000100:00100000:0.0:1788572124.777022:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788572124.777033:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518353920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572124.777077:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572124.777147:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518353920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572124.777155:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788572124.777388:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518353920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572124.904491:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572124.937410:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572124.938357:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495266048 00000100:00100000:3.0:1788572124.938370:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495266048 00000100:00100000:3.0:1788572124.938442:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:3.0:1788572124.938452:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+47:10560:x1875453495266048:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:3.0:1788572124.938532:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938550:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938561:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938575:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938581:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938587:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938680:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938705:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938712:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572124.938762:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938775:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938782:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938788:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938793:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572124.938797:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938817:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938829:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:3.0:1788572124.938832:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572124.938836:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938842:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffd16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938864:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938870:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938875:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938879:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572124.938883:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938888:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938897:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c059bcd100) 00010000:00010000:3.0:1788572124.938899:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572124.938902:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938907:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffd1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938920:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938926:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938931:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938940:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572124.938943:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938948:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938955:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572124.938957:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572124.938960:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572124.938965:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffd24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572124.939052:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+47:10560:x1875453495266048:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 600us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572124.940439:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:3.0:1788572125.008412:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572125.009002:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495266304 00000100:00100000:2.0:1788572125.009012:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495266304 00000100:00100000:2.0:1788572125.009087:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:2.0:1788572125.009096:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+47:10563:x1875453495266304:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572125.009114:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572125.009134:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffd2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fa9 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009216:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009230:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009242:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009307:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009328:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009336:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009444:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bffd40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009453:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bffd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009459:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bffd40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572125.009469:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788572125.009591:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009599:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009606:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009611:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572125.009615:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009623:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009646:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572125.009649:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572125.009654:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009660:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffd32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009673:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009679:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009684:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009689:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572125.009691:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009697:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009704:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0593ef200) 00010000:00010000:2.0:1788572125.009706:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572125.009710:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009715:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009769:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffd2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fa9 expref: 50 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009783:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bffd40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fa9 expref: 49 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.009791:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572125.009793:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572125.009796:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572125.009869:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+49:10563:x1875453495266304:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 773us (1479us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788572125.009876:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00080000:1.0:1788572125.010274:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572125.013364:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.013443:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495266432 00000100:00100000:1.0:1788572125.013452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495266432 00000100:00100000:1.0:1788572125.013702:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:1.0:1788572125.013713:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+49:10563:x1875453495266432:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:1.0:1788572125.013785:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.013811:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.013824:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.013852:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.013859:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.013866:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.013871:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572125.013875:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.013883:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.013894:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572125.013897:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572125.013902:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.013920:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572125.014004:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+49:10563:x1875453495266432:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 292us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.014012:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:3.0:1788572125.016220:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.016411:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495266688 00000100:00100000:1.0:1788572125.016422:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495266688 00000100:00100000:1.0:1788572125.016475:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:1.0:1788572125.016485:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+49:10563:x1875453495266688:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572125.016707:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+50:10563:x1875453495266688:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 223us (498us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788572125.016714:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788572125.132894:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572125.132994:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495266944 00000100:00100000:2.0:1788572125.133003:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495266944 00000100:00100000:2.0:1788572125.133078:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:2.0:1788572125.133089:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+50:10573:x1875453495266944:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572125.133116:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572125.133120:0:10431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788572125.133146:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffcd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f8d expref: 50 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.133168:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:2.0:1788572125.133174:0:10431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572125.133189:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffd55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fb0 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.133443:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.133457:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.133468:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572125.133477:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788572125.133595:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffd55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb0 expref: 52 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.133606:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb0 expref: 51 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.133611:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572125.133613:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572125.133615:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d600, rc 0) 00000100:00100000:2.0:1788572125.133667:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+51:10573:x1875453495266944:12345-192.168.202.2@tcp:101:bash.0 Request processed in 581us (784us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788572125.133671:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:0.0:1788572125.136740:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.136839:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495267200 00000100:00100000:1.0:1788572125.136860:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495267200 00000100:00100000:1.0:1788572125.136920:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:1.0:1788572125.136930:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+51:10573:x1875453495267200:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:1.0:1788572125.136987:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788572125.137009:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969bffd5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb0 expref: 51 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.137026:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bffd40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fa9 expref: 50 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.137045:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572125.137051:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572125.137463:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.137477:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.137484:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788572125.137531:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788572125.137555:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006476dd09 reply state 00000000de642a51 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572125.137564:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572125.137698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+52:10573:x1875453495267200:12345-192.168.202.2@tcp:36:bash.0 Request processed in 767us (965us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788572125.137705:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 105 00000020:00080000:1.0:1788572125.137710:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788572125.140926:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.140965:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.140973:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.140981:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572125.140987:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.140996:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.141015:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:0.0:1788572125.141019:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572125.141033:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.141041:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969bffd6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572125.145124:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572125.146005:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495267328 00000100:00100000:2.0:1788572125.146017:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495267328 00000100:00100000:2.0:1788572125.146115:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:2.0:1788572125.146126:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+51:10573:x1875453495267328:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572125.146169:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572125.146214:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffd71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fb7 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.146313:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.146327:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.146337:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572125.146365:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788572125.146368:0:10431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572125.146388:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.146411:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffd71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb7 expref: 53 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.146429:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb7 expref: 52 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.146437:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572125.146440:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572125.146443:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572125.146504:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+52:10573:x1875453495267328:12345-192.168.202.2@tcp:101:bash.0 Request processed in 380us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572125.146511:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:3.0:1788572125.150553:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.150595:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495267584 00000100:00100000:3.0:1788572125.150604:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495267584 00000100:00100000:3.0:1788572125.150661:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:3.0:1788572125.150671:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+52:10573:x1875453495267584:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:3.0:1788572125.150966:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+53:10573:x1875453495267584:12345-192.168.202.2@tcp:35:bash.0 Request processed in 296us (421us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788572125.150973:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:3.0:1788572125.206525:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572125.206636:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495267712 00000100:00100000:0.0:1788572125.206647:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495267712 00000100:00100000:0.0:1788572125.206707:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:0.0:1788572125.206718:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+53:10579:x1875453495267712:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572125.206744:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572125.206767:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969bffd7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.206883:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffd86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.206897:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffd86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.206910:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffd86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572125.206951:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788572125.206954:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572125.206972:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffd86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.206996:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969bffd7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fbe expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.207022:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffd86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fbe expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.207045:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:0.0:1788572125.207048:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572125.207052:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a200, rc 0) 00000100:00100000:0.0:1788572125.207115:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+54:10579:x1875453495267712:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 399us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572125.207122:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:3.0:1788572125.211513:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572125.211578:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495267840 00000100:00100000:0.0:1788572125.211588:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495267840 00000100:00100000:0.0:1788572125.211665:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:0.0:1788572125.211676:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+54:10579:x1875453495267840:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572125.211696:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572125.211718:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bffd8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fc5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.211783:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.211810:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.211824:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.211838:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.211845:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.211851:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.211935:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.211944:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.211952:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572125.212001:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788572125.212005:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572125.212033:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212045:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212053:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212058:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212064:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212069:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572125.212073:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212079:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212091:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:0.0:1788572125.212094:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572125.212098:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212103:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffd94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212344:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212352:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212359:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212364:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572125.212367:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212373:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212382:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0481bfd00) 00010000:00010000:0.0:1788572125.212384:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572125.212387:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212392:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bffd9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212424:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bffd8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fc5 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212440:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fc5 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.212458:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:0.0:1788572125.212460:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572125.212463:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b000, rc 0) 00000100:00100000:0.0:1788572125.212529:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+55:10579:x1875453495267840:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 854us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572125.212536:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:3.0:1788572125.218770:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572125.219125:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495268096 00000100:00100000:0.0:1788572125.219162:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495268096 00000100:00100000:0.0:1788572125.219387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:0.0:1788572125.219398:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+55:10579:x1875453495268096:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572125.219420:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572125.219443:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969bffda9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fcc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.219551:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.219568:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb7 expref: 56 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.219576:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fc5 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.219584:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.219648:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fc5 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.219671:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fc5 expref: 56 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572125.219686:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518354048:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572125.219808:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb7 expref: 56 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.219817:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb7 expref: 56 pid: 10431 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572125.219826:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518354176:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572125.219862:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572125.223564:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518354048:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572125.223579:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518354176:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572125.223607:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.225223:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.227323:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.227884:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572125.227933:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495268224 00000100:00100000:2.0:1788572125.227957:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495268224 00010000:00010000:2.0:1788572125.227999:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb7 expref: 57 pid: 10431 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572125.228325:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495268352 00000100:00100000:2.0:1788572125.228331:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495268352 00010000:00010000:2.0:1788572125.228348:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fc5 expref: 58 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572125.228462:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:1.0:1788572125.228476:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+58:2355:x1875453495268224:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572125.228491:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572125.228498:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb7 expref: 58 pid: 10431 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228510:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb7 expref: 58 pid: 10431 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228531:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bffd78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fb7 expref: 58 pid: 10431 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228561:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572125.228567:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228575:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228581:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572125.228638:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+57:2355:x1875453495268224:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 166us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.228645:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:1.0:1788572125.228664:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:1.0:1788572125.228670:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+56:2356:x1875453495268352:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572125.228677:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572125.228682:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fc5 expref: 56 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228692:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fc5 expref: 56 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228705:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969bffda2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fc5 expref: 56 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228719:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572125.228723:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228743:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228750:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228774:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572125.228806:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+55:2356:x1875453495268352:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 125us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.228812:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00010000:00010000:1.0:1788572125.228865:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.228873:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572125.228892:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788572125.229053:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969bffda9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fcc expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.229070:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fcc expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.229077:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572125.229079:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788572125.229081:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b800, rc 0) 00000100:00100000:1.0:1788572125.229106:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+55:10579:x1875453495268096:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 9711us (10346us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788572125.229113:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:1.0:1788572125.230148:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495268480 00000100:00100000:1.0:1788572125.230161:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495268480 00000100:00100000:1.0:1788572125.230224:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572125.230233:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+55:2356:x1875453495268480:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572125.230245:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572125.230269:0:5816:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 977d9e7969bffda2) 00010000:00010000:1.0:1788572125.230271:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572125.230309:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+55:2356:x1875453495268480:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 77us (2426us total) trans 0 rc 116/116 00000100:00100000:1.0:1788572125.230316:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:3.0:1788572125.233637:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.233718:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495268736 00000100:00100000:1.0:1788572125.233730:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495268736 00000100:00100000:1.0:1788572125.233792:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788572125.233811:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+55:10579:x1875453495268736:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:1.0:1788572125.233829:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572125.233871:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bffd0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fa2 expref: 55 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.233894:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572125.233899:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572125.233954:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+54:10579:x1875453495268736:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 145us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.233962:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788572125.236112:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.236469:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495268864 00000100:00100000:1.0:1788572125.236479:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495268864 00000100:00100000:1.0:1788572125.236531:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00100000:1.0:1788572125.236541:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+54:10579:x1875453495268864:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:1.0:1788572125.236669:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.236687:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.236699:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572125.237105:0:10431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788572125.237270:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+54:10579:x1875453495268864:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 706us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.237279:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00100000:3.0:1788572125.241629:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.241690:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495268992 00000100:00100000:1.0:1788572125.241699:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495268992 00000100:00100000:1.0:1788572125.241766:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 111 00000100:00100000:1.0:1788572125.241776:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+54:10579:x1875453495268992:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572125.241808:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572125.241832:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffdc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.241901:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.241912:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffdc5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fd3 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.241930:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.241966:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffdc5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fd3 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.241981:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572125.241984:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572125.241988:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffdc5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fd3 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.241996:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995000, rc 0) 00000100:00100000:1.0:1788572125.242416:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+55:10579:x1875453495268992:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 639us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.242423:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 111 00000004:00080000:0.0:1788572125.288719:0:7096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346079466468ns, next at 347079463769ns, rc = 0 00000100:00100000:2.0:1788572125.289132:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518354304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572125.289207:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572125.289277:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518354304 00000100:00100000:0.0:1788572125.289286:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518354304 00000100:00100000:0.0:1788572125.289346:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788572125.289356:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518354304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572125.289389:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572125.289448:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518354304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572125.289468:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788572125.289616:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518354304:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788572125.480514:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788572125.480524:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788572125.480583:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788572125.480591:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788572125.480730:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518354432:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788572125.480936:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c048538cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572125.484689:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572125.484849:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518354432:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572125.494926:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495269120 00000100:00100000:1.0:1788572125.494942:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495269120 00000100:00100000:1.0:1788572125.495081:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:1.0:1788572125.495092:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+55:10582:x1875453495269120:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788572125.495126:0:10431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788572125.495303:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+55:10582:x1875453495269120:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 213us (10623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.495312:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:2.0:1788572125.505761:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572125.517671:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495269248 00000100:00100000:0.0:1788572125.517690:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495269248 00000100:00100000:2.0:1788572125.518032:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1788572125.518048:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+55:10582:x1875453495269248:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788572125.518126:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518143:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518154:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518170:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518176:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518202:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518225:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518233:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518239:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572125.518316:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788572125.518321:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572125.518334:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518345:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518351:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518357:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518362:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0da00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572125.518366:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518373:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518396:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:2.0:1788572125.518400:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572125.518405:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518411:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffdcc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518425:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518431:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518438:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518443:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572125.518446:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518451:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518458:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff88c0593ef200) 00010000:00010000:2.0:1788572125.518461:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572125.518463:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518469:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffdd3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518495:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518501:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518506:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518511:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572125.518514:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518520:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518528:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572125.518531:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572125.518533:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.518539:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bffdda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572125.518635:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+55:10582:x1875453495269248:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 590us (12881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572125.518644:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1788572125.542124:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.542294:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495269504 00000100:00100000:1.0:1788572125.542305:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495269504 00000100:00100000:1.0:1788572125.542360:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:1.0:1788572125.542371:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+55:10582:x1875453495269504:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572125.542391:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572125.542426:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffde1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fda expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542529:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542545:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542559:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572125.542571:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788572125.542667:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542674:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542680:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542686:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572125.542690:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542697:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542710:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572125.542712:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788572125.542717:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542732:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffde8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542774:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffde1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fda expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542784:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:1.0:1788572125.542797:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572125.542802:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffde1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fda expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.542812:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994600, rc 0) 00000100:00100000:1.0:1788572125.542886:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+56:10582:x1875453495269504:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 517us (772us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788572125.542893:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:2.0:1788572125.547029:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.547105:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495269632 00000100:00100000:1.0:1788572125.547115:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495269632 00000100:00100000:1.0:1788572125.547180:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:1.0:1788572125.547189:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+56:10582:x1875453495269632:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788572125.547227:0:10431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788572125.547371:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+56:10582:x1875453495269632:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 182us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.547379:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:2.0:1788572125.550395:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.550503:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495269888 00000100:00100000:1.0:1788572125.550513:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495269888 00000100:00100000:1.0:1788572125.550572:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:1.0:1788572125.550592:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+56:10582:x1875453495269888:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572125.550613:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572125.550616:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788572125.550644:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffd86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fbe expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.550669:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:1.0:1788572125.550674:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572125.550687:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffdf6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fe1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572125.551105:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788572125.551415:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffdfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.551429:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffdfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.551438:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffdfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.551490:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffdf6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe1 expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.551507:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffdfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe1 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.551514:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eac800) 00010000:00010000:1.0:1788572125.551517:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572125.551527:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994400, rc 0) 00000100:00100000:1.0:1788572125.551595:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+57:10582:x1875453495269888:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1005us (1210us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788572125.551602:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:0.0:1788572125.563340:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.563428:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495270144 00000100:00100000:1.0:1788572125.563438:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495270144 00000100:00100000:1.0:1788572125.563497:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:1.0:1788572125.563508:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+57:10582:x1875453495270144:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788572125.563563:0:10431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572125.563591:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969bffdfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe1 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563611:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eac800) 00010000:00010000:1.0:1788572125.563621:0:10431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572125.563642:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563656:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563668:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563714:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563722:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563729:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563811:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563820:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563827:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563833:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572125.563848:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563856:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563866:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:1.0:1788572125.563869:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572125.563873:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563879:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563888:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563895:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563900:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563913:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572125.563916:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563923:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563931:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xbbe099e7 (ffff88c058eacc00) 00010000:00010000:1.0:1788572125.563933:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572125.563936:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.563941:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbbe099e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572125.564032:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+56:10582:x1875453495270144:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 524us (701us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572125.564041:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:3.0:1788572125.569498:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.569596:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495270272 00000100:00100000:1.0:1788572125.569607:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495270272 00000100:00100000:1.0:1788572125.569667:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:1.0:1788572125.569677:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+56:10582:x1875453495270272:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572125.569697:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572125.569720:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fe8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.569757:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.569798:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.569810:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.569919:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969bffe19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe8 expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.569937:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe8 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.569945:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:1.0:1788572125.569948:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788572125.569951:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994600, rc 0) 00000100:00100000:1.0:1788572125.570025:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+57:10582:x1875453495270272:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 349us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.570032:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:2.0:1788572125.574496:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.575079:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495270528 00000100:00100000:3.0:1788572125.575091:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495270528 00000100:00100000:3.0:1788572125.575154:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:3.0:1788572125.575163:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+57:10582:x1875453495270528:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788572125.575245:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.575296:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.575308:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572125.575661:0:10431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:3.0:1788572125.575749:0:10431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d76c973 reply state 00000000370c2eb2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.575759:0:10431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572125.576152:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+59:10582:x1875453495270528:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 987us (1662us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788572125.576174:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:2.0:1788572125.579289:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:1.0:1788572125.579821:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.579844:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.579851:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.579856:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572125.579862:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.579886:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.579904:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:1.0:1788572125.579906:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788572125.579911:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.579917:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bffe27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.580098:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495270656 00000100:00100000:3.0:1788572125.580109:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495270656 00000100:00100000:3.0:1788572125.580172:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:3.0:1788572125.580183:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+58:10582:x1875453495270656:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572125.580206:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572125.580226:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10fef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.580318:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fef expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.580332:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fef expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.580349:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:3.0:1788572125.580352:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572125.580355:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387000, rc 0) 00000100:00100000:3.0:1788572125.580639:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+59:10582:x1875453495270656:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 234us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572125.580648:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:2.0:1788572125.584196:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.590440:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495270784 00000100:00100000:1.0:1788572125.590456:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495270784 00000100:00100000:1.0:1788572125.590550:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:1.0:1788572125.590562:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495270784:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788572125.590897:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495270784:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 337us (6712us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788572125.590906:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00080000:3.0:1788572125.594297:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572125.597195:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.597451:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495271040 00000100:00100000:3.0:1788572125.597461:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495271040 00000100:00100000:3.0:1788572125.597521:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:3.0:1788572125.597532:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+59:10582:x1875453495271040:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788572125.597804:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+60:10582:x1875453495271040:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 273us (619us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788572125.597812:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1788572125.603611:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.603946:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495271296 00000100:00100000:3.0:1788572125.603957:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495271296 00000100:00100000:3.0:1788572125.604028:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:3.0:1788572125.604039:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+60:10582:x1875453495271296:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788572125.604154:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+60:10582:x1875453495271296:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 117us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572125.604162:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:2.0:1788572125.606774:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572125.606928:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495271424 00000100:00100000:0.0:1788572125.606938:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495271424 00000100:00100000:0.0:1788572125.606996:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:0.0:1788572125.607006:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+60:10582:x1875453495271424:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572125.607035:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572125.607058:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ff6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.607128:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffe3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.607155:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffe3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.607169:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffe3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572125.607232:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572125.607297:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffe3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.607326:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ff6 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.607352:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffe3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ff6 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.607361:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:0.0:1788572125.607364:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788572125.607368:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ac00, rc 0) 00000100:00100000:0.0:1788572125.607439:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+61:10582:x1875453495271424:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 433us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572125.607446:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:2.0:1788572125.609856:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.609964:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495271552 00000100:00100000:3.0:1788572125.609973:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495271552 00000100:00100000:3.0:1788572125.610027:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:3.0:1788572125.610036:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495271552:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572125.610052:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572125.610070:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb10ffd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572125.610091:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b71dd, blocks: 0x1 00010000:00010000:3.0:1788572125.610107:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1788572125.610111:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572125.610120:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ffd expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.610137:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ffd expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.610164:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387400, rc 0) 00000100:00100000:3.0:1788572125.610215:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+10:2356:x1875453495271552:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 179us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572125.610222:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:2.0:1788572125.613181:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.613762:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495271808 00000100:00100000:1.0:1788572125.613774:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495271808 00000100:00100000:1.0:1788572125.613847:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:1.0:1788572125.613857:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+61:10582:x1875453495271808:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788572125.613967:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+61:10582:x1875453495271808:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 112us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.613975:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:2.0:1788572125.616800:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.617063:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495271936 00000100:00100000:1.0:1788572125.617075:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495271936 00000100:00100000:1.0:1788572125.617152:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:1.0:1788572125.617163:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+10:10582:x1875453495271936:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572125.617182:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572125.617213:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11004 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.617297:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ffd expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.617308:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572125.617312:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572125.617319:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.617715:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ffd expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.617732:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ffd expref: 11 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572125.617747:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1875453518354560:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572125.617911:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572125.623384:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.623534:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495272064 00000100:00100000:3.0:1788572125.623545:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495272064 00010000:00010000:3.0:1788572125.623587:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ffd expref: 12 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.623624:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:3.0:1788572125.623634:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+12:2355:x1875453495272064:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572125.623649:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572125.623671:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ffd expref: 12 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.623691:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ffd expref: 12 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.623717:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572125.623722:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572125.623731:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.623741:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.623823:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.625274:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049800380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1875453518354688:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788572125.625384:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052078180 going to sleep for 11 seconds 00010000:00010000:1.0:1788572125.625543:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ffd expref: 12 pid: 6680 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572125.625561:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1875453518354560:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572125.625609:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.625623:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994400, rc 0) 00000100:00100000:1.0:1788572125.625656:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+11:10582:x1875453495271936:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 8494us (8878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.625664:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:3.0:1788572125.633469:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049800380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1875453518354688:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788572125.633499:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572125.633558:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+10:2355:x1875453495272064:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 9924us (10182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572125.633568:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:3.0:1788572125.634338:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.635524:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495272192 00000100:00100000:1.0:1788572125.635535:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495272192 00002000:00100000:1.0:1788572125.635584:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88c049800380 x1875453495272192/t0(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:541/0 lens 504/0 e 0 to 0 dl 1788572136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572125.635595:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c049800380 with x1875453495272192 ext(0->12) 00002000:00010000:1.0:1788572125.635600:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c049800380 00000100:00100000:1.0:1788572125.635635:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:1.0:1788572125.635645:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+10:2356:x1875453495272192:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788572125.636353:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+12:2356:x1875453495272192:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 707us (2016us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788572125.636363:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00002000:00100000:1.0:1788572125.636371:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88c049800380 x1875453495272192/t4294967308(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:541/0 lens 504/448 e 0 to 0 dl 1788572136 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572125.636380:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c049800380 with x1875453495272192 ext(0->12) 00002000:00010000:1.0:1788572125.636384:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c049800380 00000100:00100000:3.0:1788572125.643853:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572125.643918:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495272320 00000100:00100000:0.0:1788572125.643929:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495272320 00000100:00100000:0.0:1788572125.643992:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:0.0:1788572125.644002:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+61:10582:x1875453495272320:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000004:00080000:0.0:1788572125.758045:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:0.0:1788572125.758077:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967379 is committed 00000004:00080000:0.0:1788572125.758089:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1788572125.758111:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:0.0:1788572125.758136:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:0.0:1788572125.758169:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788572125.758190:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c051211d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788572125.758212:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07c307a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c0512113c0 00000020:00080000:0.0:1788572125.758215:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07c307b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c076c56c00 00000001:00080000:0.0:1788572125.758232:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1788572125.758279:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c04a1aef00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788572125.758282:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07636f400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c04a1aec00 00000020:00080000:0.0:1788572125.758285:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07636ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c052e6dc00 00000100:00100000:0.0:1788572125.758447:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518354816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572125.758515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572125.758598:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518354816 00000100:00100000:0.0:1788572125.758605:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518354816 00000100:00100000:0.0:1788572125.758664:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788572125.758674:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518354816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572125.758700:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788572125.758731:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b71dc, atime: 0x6a9b71dc, ctime: 0x6a9b71dc, blocks: 0x1 00010000:00010000:0.0:1788572125.758739:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.758755:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:0.0:1788572125.758760:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572125.758766:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.758793:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.758815:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.758823:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.758840:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572125.759383:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1875453518354816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 708us (866us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788572125.759391:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788572125.759423:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572125.759430:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.759438:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572125.759442:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.759452:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.759468:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.759476:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969bffe51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.759504:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572125.759506:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572125.759508:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572125.759550:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c07ba41880/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788572125.759556:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518354816:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788572125.759875:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788572125.760046:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788572125.760410:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518354944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572125.760470:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572125.760627:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518354944 00000100:00100000:3.0:1788572125.760635:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518354944 00000100:00100000:3.0:1788572125.760682:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788572125.760691:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518354944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572125.760718:0:11678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788572125.760744:0:11678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.760763:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f63 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.760771:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788572125.760798:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572125.760803:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.760834:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f63 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.760847:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f63 expref: 11 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.760860:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11678:1875453518355072:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572125.760919:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052078180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572125.763984:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+15:10582:x1875453495272320:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 119971us (120130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572125.764020:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:0.0:1788572125.764988:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049802d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11678:1875453518355072:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572125.765028:0:11678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572125.765544:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.765755:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495272448 00000100:00100000:3.0:1788572125.765763:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495272448 00010000:00010000:3.0:1788572125.765810:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f63 expref: 12 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.765846:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:3.0:1788572125.765857:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+12:2355:x1875453495272448:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572125.765872:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572125.765878:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f63 expref: 12 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.765891:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f63 expref: 12 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.765938:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4174902/0x977d9e7969bffc13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f63 expref: 12 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.765957:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572125.765962:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572125.765967:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.765977:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.766026:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572125.766082:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+11:2355:x1875453495272448:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 226us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572125.766090:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00010000:00010000:1.0:1788572125.766119:0:11678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.766130:0:11678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.766140:0:11678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.766148:0:11678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.766172:0:11678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572125.766478:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572125.766485:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.766493:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572125.766498:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.766508:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.766533:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.766541:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000259b8dce/0x977d9e7969bffe58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.766560:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572125.766562:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572125.766564:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572125.767095:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3297:x1875453518354944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6403us (6621us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788572125.767104:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1788572125.767170:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c049802300/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788572125.767184:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518354944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572125.770207:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572125.772961:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495272576 00000100:00100000:0.0:1788572125.772981:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495272576 00000100:00100000:0.0:1788572125.773079:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1788572125.773091:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+11:2354:x1875453495272576:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788572125.917531:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788572125.917548:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788572125.917906:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2354:x1875453495272576:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 144810us (147702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572125.917919:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:2.0:1788572125.921403:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572125.925813:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495272832 00000100:00100000:3.0:1788572125.925833:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495272832 00000100:00100000:0.0:1788572125.929816:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:0.0:1788572125.929832:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+15:10582:x1875453495272832:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788572125.929893:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572125.929924:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffe3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10ff6 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.929950:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:0.0:1788572125.929956:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572125.929986:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.930895:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.930909:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572125.931187:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a2dd5f3 reply state 00000000d82f7820 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572125.931197:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572125.931354:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+16:10582:x1875453495272832:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1523us (9960us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788572125.931364:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 125 00010000:00010000:0.0:1788572125.931399:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572125.935652:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.935669:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.935677:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.935683:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572125.935688:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.935697:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.935719:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:0.0:1788572125.935736:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572125.935744:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.935751:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bffe5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572125.938863:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572125.939277:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495272960 00000100:00100000:2.0:1788572125.939289:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495272960 00000100:00100000:2.0:1788572125.939345:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1788572125.939357:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495272960:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788572125.940069:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788572125.940093:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788572125 00002000:00010000:2.0:1788572125.940096:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788572124 00002000:00010000:2.0:1788572125.940099:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788572125 -> 1788572125 00002000:00010000:2.0:1788572125.940102:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788572125.940226:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495272960:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 869us (1371us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788572125.940236:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1788572125.964534:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572125.964737:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495273216 00000100:00100000:1.0:1788572125.964748:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495273216 00000100:00100000:1.0:1788572125.964835:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:1.0:1788572125.964846:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+15:10582:x1875453495273216:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788572125.964924:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.964942:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe8 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.964972:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.965022:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe8 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.965037:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe8 expref: 15 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572125.965050:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518355200:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572125.965149:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474ff3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572125.970417:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518355200:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572125.970454:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.971093:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572125.971301:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495273344 00000100:00100000:0.0:1788572125.971312:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495273344 00010000:00010000:0.0:1788572125.971356:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe8 expref: 16 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572125.971392:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:0.0:1788572125.971402:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+16:2356:x1875453495273344:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572125.971430:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572125.971438:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe8 expref: 16 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.971452:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe8 expref: 16 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.971475:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bffe20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fe8 expref: 16 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.971492:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:0.0:1788572125.971497:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.971525:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.971532:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572125.971565:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572125.971633:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+15:2356:x1875453495273344:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 232us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572125.971641:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00010000:00010000:1.0:1788572125.972138:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.972148:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.972179:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.972186:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.972194:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.972208:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572125.972214:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.972222:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.972233:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:1.0:1788572125.972236:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788572125.972239:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572125.972245:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bffe66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572125.972350:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+14:10582:x1875453495273216:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 7504us (7825us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788572125.972358:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:3.0:1788572125.976959:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572125.977108:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495273472 00000100:00100000:2.0:1788572125.977120:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495273472 00000100:00100000:2.0:1788572125.977181:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:2.0:1788572125.977191:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2353:x1875453495273472:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788572125.977234:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.977288:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.977298:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572125.977303:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572125.977308:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.977343:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.977357:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 7 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572125.977392:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518355328:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572125.989965:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211600 going to sleep for 11 seconds 00000100:00100000:3.0:1788572125.990479:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518355328:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572125.990510:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.994355:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572125.995059:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495273600 00000100:00100000:2.0:1788572125.995071:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495273600 00010000:00010000:2.0:1788572125.995117:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 8 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572125.995164:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:2.0:1788572125.995174:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495273600:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572125.995189:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572125.995213:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 8 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.995228:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 8 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.995272:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005016f557/0x977d9e7969bffe4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11004 expref: 8 pid: 6679 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.995289:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572125.995294:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572125.995300:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.995310:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572125.995361:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572125.995480:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495273600:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 307us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572125.995488:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00010000:00010000:3.0:1788572125.995911:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.995923:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.995962:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.995971:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.995979:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.995987:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572125.995992:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.996014:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.996035:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572125.996044:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969bffe6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572125.996094:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495273472:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 18904us (19145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572125.996103:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:2.0:1788572126.000866:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572126.000988:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495273856 00000100:00100000:1.0:1788572126.000999:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495273856 00000100:00100000:1.0:1788572126.001063:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:1.0:1788572126.001073:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+14:10582:x1875453495273856:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788572126.001147:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.001165:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.001177:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.001445:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.001457:0:10431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fef expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.001467:0:10431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.001500:0:10431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fef expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.001513:0:10431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fef expref: 15 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572126.001528:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518355456:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572126.001603:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474ff3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572126.005192:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572126.005285:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495273984 00000100:00100000:0.0:1788572126.005294:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495273984 00010000:00010000:0.0:1788572126.005336:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fef expref: 16 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572126.005380:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:0.0:1788572126.005390:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+16:2355:x1875453495273984:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572126.005405:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572126.005411:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fef expref: 16 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.005424:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fef expref: 16 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.005445:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:0.0:1788572126.005449:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.005476:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.005483:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.005505:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572126.005568:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+16:2355:x1875453495273984:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 179us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572126.005576:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00010000:00010000:3.0:1788572126.005970:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fef expref: 15 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572126.005989:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518355456:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572126.006016:0:10431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.006026:0:10431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.006032:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572126.006235:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788572126.006479:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788572126.006525:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788572126.006732:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049800000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518355584:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788572126.006801:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572126.006940:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c041484480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572126.011581:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518355584 00000100:00100000:0.0:1788572126.011599:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518355584 00000100:00100000:1.0:1788572126.011871:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572126.011885:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10431:x1875453518355584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788572126.012049:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10431:x1875453518355584:12345-0@lo:1000:mdt00_003.0 Request processed in 167us (5247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572126.012057:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788572126.012365:0:10431:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788572126.012371:0:10431:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788572126.012395:0:10431:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c049802300, transno 4294967309 00000100:00100000:2.0:1788572126.012417:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049800000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518355584:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788572126.013169:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788572126.013290:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518355712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572126.013356:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572126.013438:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211c00 going to sleep for 11 seconds 00000100:00080000:3.0:1788572126.013576:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572126.014726:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518355712 00000100:00100000:0.0:1788572126.014737:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518355712 00000100:00100000:0.0:1788572126.014798:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788572126.014811:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10431:x1875453518355712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572126.015367:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518355712:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788572126.015410:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015432:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015441:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015447:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572126.015454:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015478:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015496:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eacc00) 00010000:00010000:2.0:1788572126.015499:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572126.015504:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015510:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969bffe7b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015539:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015545:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015551:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015555:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572126.015558:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015563:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015570:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572126.015572:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572126.015600:0:10431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffdc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fd3 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015634:0:10431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffdc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fd3 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015643:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffdc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fd3 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.015676:0:10431:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffdc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fd3 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572126.015690:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049807480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518355840:192.168.202.2@tcp:105: 00000100:00100000:0.0:1788572126.016128:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10431:x1875453518355712:12345-0@lo:1000:mdt00_003.0 Request processed in 1317us (2769us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788572126.016137:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788572126.019856:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051211c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572126.032368:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572126.032528:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495274112 00000100:00100000:0.0:1788572126.032538:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495274112 00000100:00100000:0.0:1788572126.032603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:0.0:1788572126.032625:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+19:10579:x1875453495274112:12345-192.168.202.2@tcp:49:lfs.0 00000100:00100000:0.0:1788572126.032921:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+19:10579:x1875453495274112:12345-192.168.202.2@tcp:49:lfs.0 Request processed in 307us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572126.032929:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1788572126.039898:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049807480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518355840:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788572126.039932:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.039944:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969bffdbe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.039977:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040015:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040028:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040040:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040047:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040053:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040058:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572126.040063:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040070:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040081:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572126.040085:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572126.040089:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040102:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffe82 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040116:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040136:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040143:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040148:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572126.040151:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040165:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040174:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572126.040176:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788572126.040179:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.040184:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969bffe74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572126.040463:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+18:10582:x1875453495273856:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 39389us (39604us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788572126.040474:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 127 00000020:00080000:3.0:1788572126.040481:0:10431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788572126.041115:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788572126.041128:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788572126.042201:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788572126.042213:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788572126.043648:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572126.043840:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495274368 00000100:00100000:1.0:1788572126.043851:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495274368 00000100:00100000:1.0:1788572126.043911:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:1.0:1788572126.043922:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+18:10579:x1875453495274368:12345-192.168.202.2@tcp:58:lfs.0 00000040:00080000:1.0:1788572126.044340:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788572126.044436:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+18:10579:x1875453495274368:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 515us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572126.044444:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:2.0:1788572126.047342:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572126.047547:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495274624 00000100:00100000:0.0:1788572126.047557:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495274624 00000100:00100000:0.0:1788572126.047612:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:0.0:1788572126.047623:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050316850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+18:10582:x1875453495274624:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788572126.054928:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788572126.056796:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788572126.056887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.056906:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.056917:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.056926:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.056933:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.056939:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.059875:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572126.060036:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050316850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+20:10582:x1875453495274624:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 12409us (12697us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788572126.060048:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000020:00080000:1.0:1788572126.060055:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788572126.060203:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572126.060212:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.060221:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572126.060226:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.060236:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.060280:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88c058eac800) 00010000:00010000:0.0:1788572126.060285:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572126.060290:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.060297:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bffe89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572126.060873:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572126.060890:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572126.060892:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572126.115361:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572126.115461:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495274752 00000100:00100000:0.0:1788572126.115473:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495274752 00000100:00100000:0.0:1788572126.115537:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:0.0:1788572126.115547:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+20:10584:x1875453495274752:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572126.115588:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572126.115621:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffe90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1100b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.115684:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.115700:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.115712:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.115728:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.115734:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.115741:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.115990:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.116014:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fcc expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.116023:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.116060:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fcc expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572126.116080:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fcc expref: 21 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572126.116095:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518355968:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572126.116203:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572126.119182:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518355968:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572126.119213:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572126.122042:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572126.122303:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495275008 00000100:00100000:1.0:1788572126.122314:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495275008 00000100:00100000:1.0:1788572126.122384:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:1.0:1788572126.122395:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+22:5594:x1875453495275008:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788572126.122668:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+23:5594:x1875453495275008:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 274us (637us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788572126.122676:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:3.0:1788572126.129794:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572126.129934:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495275136 00000100:00100000:2.0:1788572126.129944:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495275136 00010000:00010000:2.0:1788572126.129985:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fcc expref: 23 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572126.131847:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:2.0:1788572126.131871:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+23:2356:x1875453495275136:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572126.131891:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572126.131904:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fcc expref: 23 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.131919:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fcc expref: 23 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.131955:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969bffdb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fcc expref: 23 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.131979:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:2.0:1788572126.131984:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.131994:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.132013:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572126.132054:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572126.132126:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049802a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+22:2356:x1875453495275136:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 267us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572126.132134:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00010000:00010000:3.0:1788572126.132274:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132284:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572126.132334:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788572126.132339:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572126.132357:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132369:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132378:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132384:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132391:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132396:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ba00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572126.132401:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132408:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132419:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:3.0:1788572126.132422:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572126.132426:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132433:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bffe97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132457:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132463:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132469:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132473:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024aa00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572126.132476:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132482:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132495:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88c0481bf300) 00010000:00010000:3.0:1788572126.132497:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572126.132501:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132506:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969bffe9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132541:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969bffe90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1100b expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132554:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1100b expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572126.132572:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572126.132574:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572126.132577:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024be00, rc 0) 00000100:00100000:3.0:1788572126.132618:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+21:10584:x1875453495274752:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 17073us (17269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572126.132626:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 129 00010000:00010000:3.0:1788572126.952941:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572127.085081:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572127.085092:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572127.085151:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788572127.085158:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788572127.085311:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518356096:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572127.085420:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf47603e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572127.092583:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518356096:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572127.101369:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572127.102100:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495275264 00000100:00100000:0.0:1788572127.102111:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495275264 00000100:00100000:0.0:1788572127.102197:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:0.0:1788572127.102207:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+21:10595:x1875453495275264:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1788572127.102237:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:0.0:1788572127.102242:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788572127.112295:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+21:10595:x1875453495275264:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 10065us (10913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.112309:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:0.0:1788572127.117174:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572127.117322:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495275520 00000100:00100000:3.0:1788572127.117333:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495275520 00000100:00100000:3.0:1788572127.117385:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00100000:3.0:1788572127.117395:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+21:10595:x1875453495275520:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572127.117427:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572127.117450:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffeac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11012 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.117541:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffeb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.117555:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.117567:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572127.117588:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788572127.117700:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bffeac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11012 expref: 24 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.117733:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffeb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11012 expref: 23 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.117752:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572127.117755:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572127.117758:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387400, rc 0) 00000100:00100000:3.0:1788572127.118076:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+23:10595:x1875453495275520:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 680us (910us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788572127.118083:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00100000:3.0:1788572127.146313:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572127.146357:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495275648 00000100:00100000:3.0:1788572127.146367:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495275648 00000100:00100000:3.0:1788572127.147634:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788572127.147653:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+23:2353:x1875453495275648:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572127.147671:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572127.147699:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bffeb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11012 expref: 23 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572127.147720:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572127.147726:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572127.147808:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+22:2353:x1875453495275648:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 162us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572127.147816:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788572127.148462:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572127.151183:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495275904 00000100:00100000:1.0:1788572127.151201:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495275904 00000100:00100000:1.0:1788572127.151396:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:1.0:1788572127.151408:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+22:10595:x1875453495275904:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788572127.151773:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.151802:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.151816:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.152149:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.152158:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.152164:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.152171:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572127.152176:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.152184:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.152197:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:1.0:1788572127.152200:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788572127.152204:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.152210:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969bffec1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572127.152393:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+23:10595:x1875453495275904:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 986us (3931us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788572127.152402:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 132 00000040:00080000:2.0:1788572127.152465:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788572127.152470:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572127.152962:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788572127.152972:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788572127.155880:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572127.155966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495276160 00000100:00100000:2.0:1788572127.155976:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495276160 00000100:00100000:2.0:1788572127.156107:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:2.0:1788572127.156119:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+23:10595:x1875453495276160:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788572127.156413:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+24:10595:x1875453495276160:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 296us (541us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788572127.156426:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000040:00080000:1.0:1788572127.208560:0:12099:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572127.208570:0:12099:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572127.208615:0:12099:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788572127.208628:0:12099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788572127.507766:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572127.507901:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495276416 00000100:00100000:0.0:1788572127.507913:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495276416 00000100:00100000:0.0:1788572127.507981:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:0.0:1788572127.507995:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+24:10608:x1875453495276416:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572127.508024:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572127.508054:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11019 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.508178:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffecf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.508195:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.508211:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffecf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572127.508223:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788572127.508390:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11019 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.508415:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11019 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.508423:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:0.0:1788572127.508427:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788572127.508430:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a200, rc 0) 00000100:00100000:0.0:1788572127.508485:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+26:10608:x1875453495276416:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 492us (728us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788572127.508492:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:1.0:1788572127.541093:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572127.542031:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495276544 00000100:00100000:0.0:1788572127.542045:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495276544 00000100:00100000:0.0:1788572127.542102:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:0.0:1788572127.542114:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+26:10608:x1875453495276544:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:0.0:1788572127.542205:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.542242:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.542278:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.542317:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.542324:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.542331:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.542337:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572127.542342:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.542350:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.542362:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:0.0:1788572127.542366:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572127.542370:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572127.542377:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969bffedd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572127.542465:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07679aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+26:10608:x1875453495276544:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 353us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572127.542472:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:0.0:1788572127.681359:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572127.681581:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495276672 00000100:00100000:1.0:1788572127.681591:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495276672 00000100:00100000:1.0:1788572127.681670:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:1.0:1788572127.681681:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495276672:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:1.0:1788572127.681697:0:11678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572127.681717:0:11678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaadb370/0x977d9e7969bffee4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11020 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572127.681754:0:11678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b71dd, atime: 0x6a9b71dc, ctime: 0x6a9b71dd, blocks: 0xb 00010000:00010000:1.0:1788572127.681776:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1788572127.681780:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572127.681790:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaadb370/0x977d9e7969bffee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11020 expref: 7 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.681810:0:11678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eaadb370/0x977d9e7969bffee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11020 expref: 7 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572127.681823:0:11678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995400, rc 0) 00000100:00100000:1.0:1788572127.681894:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495276672:12345-192.168.202.2@tcp:101:cat.0 Request processed in 215us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572127.681900:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00080000:3.0:1788572127.682661:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572127.687889:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572127.690566:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495276800 00000100:00100000:1.0:1788572127.690583:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495276800 00002000:00100000:1.0:1788572127.690651:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff88c07ba43b80 x1875453495276800/t0(0) o3->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:543/0 lens 488/0 e 0 to 0 dl 1788572138 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572127.690686:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07ba43b80 with x1875453495276800 ext(0->4095) 00002000:00010000:1.0:1788572127.690692:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c07ba43b80 00000100:00100000:1.0:1788572127.690812:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1788572127.690823:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2353:x1875453495276800:12345-192.168.202.2@tcp:3:cat.0 00000100:00100000:1.0:1788572127.691065:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2353:x1875453495276800:12345-192.168.202.2@tcp:3:cat.0 Request processed in 242us (3187us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788572127.691073:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00002000:00100000:1.0:1788572127.691080:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff88c07ba43b80 x1875453495276800/t0(0) o3->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:543/0 lens 488/4536 e 0 to 0 dl 1788572138 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572127.691090:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07ba43b80 with x1875453495276800 ext(0->4095) 00002000:00010000:1.0:1788572127.691093:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c07ba43b80 00000001:00080000:2.0:1788572127.951580:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788572127.951602:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1788572127.980215:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572129.001535:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572129.194810:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572129.194819:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572129.194876:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788572129.194882:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788572129.384928:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572129.389069:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518356352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572129.389168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572129.389233:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572129.389239:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518356480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572129.389283:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572129.389474:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518356352 00000100:00100000:2.0:1788572129.389482:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518356352 00000100:00100000:2.0:1788572129.389538:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518356480 00000100:00100000:2.0:1788572129.389541:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518356480 00000100:00100000:2.0:1788572129.389572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788572129.389581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518356352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572129.389690:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518356352:12345-0@lo:400:kworker.0 Request processed in 99us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572129.389698:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788572129.389718:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788572129.389725:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518356480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572129.389752:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518356480:12345-0@lo:400:kworker.0 Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572129.389758:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1788572129.389776:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572129.389815:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518356480:0@lo:400:kworker.0 00000100:00100000:2.0:1788572129.389827:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518356352:0@lo:400:kworker.0 00000100:00100000:3.0:1788572129.397184:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518356608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572129.397282:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572129.397340:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518356224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572129.397373:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572129.402047:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518356608 00000100:00100000:2.0:1788572129.402064:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518356608 00000100:00100000:2.0:1788572129.402150:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788572129.402161:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518356608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572129.402282:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518356608:12345-0@lo:400:kworker.0 Request processed in 124us (5000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572129.402302:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788572129.402333:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518356224 00000100:00100000:2.0:1788572129.402338:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518356224 00000100:00100000:2.0:1788572129.402365:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788572129.402372:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518356224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572129.402407:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518356224:12345-0@lo:400:kworker.0 Request processed in 36us (5033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572129.402414:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:2.0:1788572129.402448:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572129.403292:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572129.403310:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518356864:0@lo:400:kworker.0 00000100:00100000:1.0:1788572129.403355:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572129.403396:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518356864 00000100:00100000:1.0:1788572129.403401:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518356864 00000100:00100000:1.0:1788572129.403436:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788572129.403443:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518356864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572129.403483:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518356864:12345-0@lo:400:kworker.0 Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572129.403567:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788572129.403605:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788572129.403610:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788572129.403630:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c07ba41880, transno 4294967304 00000100:00100000:1.0:1788572129.403645:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518356864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572129.404036:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518356608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572129.404603:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518356224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572129.404623:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572129.404632:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518356736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572129.404672:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572129.405030:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572129.405059:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518356736 00000100:00100000:2.0:1788572129.405065:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518356736 00000100:00100000:2.0:1788572129.405117:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788572129.405126:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518356736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572129.405173:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518356736:12345-0@lo:400:kworker.0 Request processed in 48us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572129.405179:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1788572129.406492:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572129.408879:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518356736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572129.628435:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572129.628474:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572129.628508:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572129.628801:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495277056 00000100:00100000:0.0:1788572129.628811:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495277056 00000100:00100000:0.0:1788572129.628876:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00100000:0.0:1788572129.628887:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+26:2356:x1875453495277056:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572129.628980:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+26:2356:x1875453495277056:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 95us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572129.628988:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00080000:0.0:1788572129.629016:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572129.629358:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572129.629408:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572129.629435:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495277312 00000100:00100000:3.0:1788572129.629441:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495277312 00000100:00100000:3.0:1788572129.629474:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495277184 00000100:00100000:3.0:1788572129.629477:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495277184 00000100:00100000:3.0:1788572129.629499:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1788572129.629507:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495277312:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572129.629627:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495277312:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 119us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572129.629650:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1788572129.629665:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:3.0:1788572129.629683:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495277184:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572129.629710:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495277184:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 39us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572129.629716:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:3.0:1788572129.629888:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495276928 00000100:00100000:3.0:1788572129.629893:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495276928 00000100:00100000:3.0:1788572129.629992:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 294 00000100:00100000:3.0:1788572129.629999:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495276928:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572129.630028:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495276928:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 29us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572129.630034:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 294 00000100:00100000:3.0:1788572129.630062:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495277440 00000100:00100000:3.0:1788572129.630066:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495277440 00000100:00100000:3.0:1788572129.630094:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 153 00000100:00100000:3.0:1788572129.630100:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495277440:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572129.630126:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495277440:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572129.630133:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 153 00000100:00080000:0.0:1788572129.630424:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572129.630430:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572129.630432:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572129.896813:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518356992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572129.896901:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572129.897227:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518356992 00000100:00100000:0.0:1788572129.897241:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518356992 00000100:00100000:0.0:1788572129.897338:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788572129.897352:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518356992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572129.897413:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572129.897474:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518356992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572129.897482:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788572129.897683:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518356992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572130.024602:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572130.408465:0:7096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351199212292ns, next at 352199209820ns, rc = 0 00000100:00100000:2.0:1788572130.408538:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572130.408561:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518357120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572130.408629:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572130.408855:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518357120 00000100:00100000:0.0:1788572130.408864:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518357120 00000100:00100000:0.0:1788572130.408931:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788572130.408941:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518357120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572130.408976:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572130.409035:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518357120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572130.409042:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788572130.409173:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518357120:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788572131.017598:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788572131.017619:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1788572131.049423:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572131.076767:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1788572131.076802:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788572131.076846:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c051211b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788572131.076851:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07c307c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c0512116c0 00000020:00080000:0.0:1788572131.076855:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c07c307600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c076c62400 00000020:00080000:0.0:1788572131.076886:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788572131.077002:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788572131.077193:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788572131.078300:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518357248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788572131.078372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572131.078459:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518357248 00000100:00100000:0.0:1788572131.078474:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518357248 00000100:00100000:0.0:1788572131.078549:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788572131.078561:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518357248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788572131.078804:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788572131.078808:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788572125 -> 1788572125 00002000:00010000:0.0:1788572131.078823:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788572124 -> 1788572124 00002000:00010000:0.0:1788572131.078825:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788572125 -> 1788572125 00002000:00010000:0.0:1788572131.078828:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00080000:1.0:1788572131.079015:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572131.079294:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518357248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 734us (920us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788572131.079303:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788572131.080708:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788572131.080718:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1788572131.080754:0:3298:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88c076799f80 x1875453518357248/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788572147 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788572131.080767:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c076799f80/2, rc 0, transno 4294967312 00000100:00100000:1.0:1788572131.080772:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518357248:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788572132.073563:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572133.102543:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572133.645075:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572133.645282:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495277568 00000100:00100000:1.0:1788572133.645291:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495277568 00000100:00100000:1.0:1788572133.645367:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00100000:1.0:1788572133.645380:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+13:10259:x1875453495277568:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788572133.645477:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+13:10259:x1875453495277568:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 Request processed in 100us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572133.645484:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00080000:3.0:1788572133.645885:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572133.648375:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572133.648484:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495277824 00000100:00100000:1.0:1788572133.648495:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495277824 00000100:00100000:1.0:1788572133.648580:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:1.0:1788572133.648591:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+13:10259:x1875453495277824:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788572133.648977:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+14:10259:x1875453495277824:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 387us (612us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788572133.648987:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:3.0:1788572134.031733:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572134.031929:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495277952 00000100:00100000:2.0:1788572134.031951:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495277952 00000100:00100000:2.0:1788572134.032023:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:2.0:1788572134.032034:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:11063:x1875453495277952:12345-192.168.202.2@tcp:101:lsof.0 00010000:00010000:2.0:1788572134.032053:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572134.032073:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffeeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11027 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572134.032133:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572134.032148:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572134.032161:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572134.032198:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788572134.032202:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572134.032240:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572134.032299:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969bffeeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11027 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572134.032318:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11027 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572134.032328:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:2.0:1788572134.032331:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572134.032335:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0dc00, rc 0) 00000100:00100000:2.0:1788572134.032405:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:11063:x1875453495277952:12345-192.168.202.2@tcp:101:lsof.0 Request processed in 373us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572134.032412:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00080000:3.0:1788572134.039029:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788572134.120491:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572134.506796:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518357376:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.506873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572134.506926:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518357888:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.506952:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572134.506978:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788572134.506984:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518357504:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572134.507027:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518358016:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572134.507079:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518357632:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507100:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572134.507120:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572134.507125:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518357760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572134.507271:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518358016 00000100:00100000:0.0:1788572134.507346:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518358016 00000100:00100000:0.0:1788572134.507395:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518357760 00000100:00100000:0.0:1788572134.507411:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518357760 00000100:00100000:0.0:1788572134.507440:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788572134.507448:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518358016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507498:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518358016:12345-0@lo:400:kworker.0 Request processed in 50us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572134.507505:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788572134.507522:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788572134.507529:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518357760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507571:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518357760:12345-0@lo:400:kworker.0 Request processed in 43us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572134.507577:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788572134.507602:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518357888 00000100:00100000:0.0:1788572134.507605:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518357888 00000100:00100000:0.0:1788572134.507629:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518357504 00000100:00100000:0.0:1788572134.507632:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518357504 00000100:00100000:0.0:1788572134.507641:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518357632 00000100:00100000:0.0:1788572134.507644:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518357632 00000100:00100000:0.0:1788572134.507657:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788572134.507663:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518357888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507693:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518357888:12345-0@lo:400:kworker.0 Request processed in 30us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572134.507700:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788572134.507711:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788572134.507717:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518357504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507744:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518357504:12345-0@lo:400:kworker.0 Request processed in 28us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572134.507750:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788572134.507769:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788572134.507775:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518357632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507802:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518357632:12345-0@lo:400:kworker.0 Request processed in 27us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572134.507808:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788572134.507847:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518357760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507857:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518357632:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507887:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518357504:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507895:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518358016:0@lo:400:kworker.0 00000100:00100000:0.0:1788572134.507905:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518357888:0@lo:400:kworker.0 00000100:00100000:2.0:1788572134.508397:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518357376 00000100:00100000:2.0:1788572134.508403:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518357376 00000100:00100000:2.0:1788572134.508443:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788572134.508450:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518357376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572134.508498:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518357376:12345-0@lo:400:kworker.0 Request processed in 49us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572134.508505:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788572134.508993:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518357376:0@lo:400:kworker.0 00000100:00080000:3.0:1788572134.509854:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572134.509861:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572134.509865:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572134.742442:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572134.742497:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572134.742548:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572134.742586:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572134.742620:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572134.742654:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495278592 00000100:00100000:1.0:1788572134.742787:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495278208 00000100:00100000:1.0:1788572134.742797:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495278208 00000100:00100000:1.0:1788572134.742864:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 157 00000100:00100000:1.0:1788572134.742874:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+14:2356:x1875453495278208:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572134.742973:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+14:2356:x1875453495278208:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 100us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572134.742981:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 157 00000100:00100000:1.0:1788572134.743034:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495278336 00000100:00100000:1.0:1788572134.743038:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495278336 00000100:00100000:1.0:1788572134.743068:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495278464 00000100:00100000:1.0:1788572134.743071:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495278464 00000100:00100000:1.0:1788572134.743092:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:1.0:1788572134.743099:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495278336:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572134.743127:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495278336:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572134.743135:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:1.0:1788572134.743146:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:1.0:1788572134.743153:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495278464:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572134.743177:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495278464:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572134.743201:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00080000:1.0:1788572134.743381:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572134.743385:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572134.744091:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495278592 00000100:00100000:3.0:1788572134.744144:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 158 00000100:00100000:3.0:1788572134.744153:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2356:x1875453495278592:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572134.744209:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2356:x1875453495278592:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 57us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572134.744216:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 158 00000100:00100000:2.0:1788572134.744305:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495278080 00000100:00100000:2.0:1788572134.744310:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495278080 00000100:00100000:2.0:1788572134.744345:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 296 00000100:00100000:2.0:1788572134.744352:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495278080:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572134.744380:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495278080:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 29us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572134.744386:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 296 00000100:00100000:2.0:1788572135.016618:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518358144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572135.016727:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572135.016901:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518358144 00000100:00100000:0.0:1788572135.016979:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518358144 00000100:00100000:0.0:1788572135.017082:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788572135.017093:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bd9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518358144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572135.017144:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572135.017206:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bd9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518358144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572135.017213:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788572135.017295:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518358144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572135.145063:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572135.532827:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572135.532859:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518358272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572135.532942:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572135.533020:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518358272 00000100:00100000:3.0:1788572135.533028:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518358272 00000100:00100000:3.0:1788572135.533083:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788572135.533105:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518358272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572135.533154:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572135.533222:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518358272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572135.533230:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788572135.533358:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518358272:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788572136.116673:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788572136.129396:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788572136.129420:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788572136.129538:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788572136.129548:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788572136.168438:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572137.192656:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572138.220593:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788572138.757463:0:12302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:35:37 (1788572137) 00010000:00010000:3.0:1788572139.242151:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572139.432643:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572139.432655:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572139.433172:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788572139.433181:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788572139.624596:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518358784:0@lo:400:kworker.0 00000100:00100000:3.0:1788572139.624668:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518358656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572139.624677:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572139.624709:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572139.624758:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518358784 00000100:00100000:1.0:1788572139.624765:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518358784 00000100:00100000:3.0:1788572139.624766:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518358656 00000100:00100000:3.0:1788572139.624769:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518358656 00000100:00100000:2.0:1788572139.624822:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518358528:0@lo:400:kworker.0 00000100:00100000:2.0:1788572139.624853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572139.624871:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518359040:0@lo:400:kworker.0 00000100:00100000:2.0:1788572139.624892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572139.624909:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572139.624914:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518358400:0@lo:400:kworker.0 00000100:00100000:2.0:1788572139.624943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572139.624966:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518358912:0@lo:400:kworker.0 00000100:00100000:2.0:1788572139.624987:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572139.625020:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518358528 00000100:00100000:2.0:1788572139.625023:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518358528 00000100:00100000:2.0:1788572139.625059:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518358912 00000100:00100000:2.0:1788572139.625062:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518358912 00000100:00100000:0.0:1788572139.625123:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788572139.625147:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518358528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572139.625203:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518358528:12345-0@lo:400:kworker.0 Request processed in 58us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572139.625211:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788572139.625235:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518359040 00000100:00100000:0.0:1788572139.625238:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518359040 00000100:00100000:1.0:1788572139.625325:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788572139.625332:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518358784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572139.625371:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518358784:12345-0@lo:400:kworker.0 Request processed in 40us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572139.625377:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788572139.628599:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788572139.629015:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518358656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572139.629111:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518358656:12345-0@lo:400:kworker.0 Request processed in 500us (4400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572139.629119:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788572139.629815:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518358656:0@lo:400:kworker.0 00000100:00100000:2.0:1788572139.629913:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788572139.629923:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518358912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572139.629974:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518358912:12345-0@lo:400:kworker.0 Request processed in 52us (4983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572139.629980:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788572139.630039:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518358912:0@lo:400:kworker.0 00000100:00100000:2.0:1788572139.630052:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518358528:0@lo:400:kworker.0 00000100:00100000:2.0:1788572139.630088:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788572139.630093:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c076799f80, transno 4294967312 00000100:00100000:2.0:1788572139.630117:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518358784:0@lo:400:kworker.0 00000100:00100000:3.0:1788572139.630300:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518358400 00000100:00100000:3.0:1788572139.630307:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518358400 00000100:00100000:3.0:1788572139.630336:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788572139.630685:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788572139.630695:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518359040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572139.630750:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518359040:12345-0@lo:400:kworker.0 Request processed in 57us (5857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572139.630757:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788572139.630792:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518359040:0@lo:400:kworker.0 00000100:00100000:3.0:1788572139.630801:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518358400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572139.630854:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518358400:12345-0@lo:400:kworker.0 Request processed in 512us (5910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572139.630861:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788572139.631132:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518358400:0@lo:400:kworker.0 00000100:00080000:1.0:1788572139.639885:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572139.639898:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572139.639901:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572139.862765:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572139.862809:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572139.862847:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572139.862885:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572139.862909:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572139.863001:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495278976 00000100:00100000:1.0:1788572139.863013:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495278976 00000100:00100000:1.0:1788572139.863091:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495279104 00000100:00100000:1.0:1788572139.863094:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495279104 00000100:00100000:1.0:1788572139.863119:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:1.0:1788572139.863129:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495278976:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572139.863214:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495278976:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 86us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572139.863240:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:1.0:1788572139.863296:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:1.0:1788572139.863304:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495279104:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572139.863329:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2355:x1875453495279104:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572139.863335:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00080000:0.0:1788572139.863932:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572139.863937:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572139.864588:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495279232 00000100:00100000:2.0:1788572139.864599:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495279232 00000100:00100000:2.0:1788572139.864668:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495278848 00000100:00100000:2.0:1788572139.864672:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495278848 00000100:00100000:2.0:1788572139.864700:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 162 00000100:00100000:2.0:1788572139.864708:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2355:x1875453495279232:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572139.864771:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2355:x1875453495279232:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 63us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572139.864780:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 162 00000100:00100000:2.0:1788572139.864799:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 163 00000100:00100000:2.0:1788572139.864806:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf45197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+13:2355:x1875453495278848:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572139.864831:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf45197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+13:2355:x1875453495278848:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572139.864838:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 163 00000100:00080000:0.0:1788572139.864956:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572139.865421:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495278720 00000100:00100000:3.0:1788572139.866855:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495278720 00000100:00100000:3.0:1788572139.866931:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 298 00000100:00100000:3.0:1788572139.866941:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2355:x1875453495278720:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572139.867009:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2355:x1875453495278720:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 69us (4255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572139.867017:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 298 00000100:00100000:3.0:1788572140.137350:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518359168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572140.137466:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572140.138010:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518359168 00000100:00100000:1.0:1788572140.138020:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518359168 00000100:00100000:1.0:1788572140.138074:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788572140.138084:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518359168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572140.138119:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572140.138231:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518359168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572140.138239:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788572140.143133:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518359168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572140.266446:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572140.517477:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572140.517865:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495279488 00000100:00100000:2.0:1788572140.517875:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495279488 00000100:00100000:2.0:1788572140.517951:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:2.0:1788572140.517963:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+13:11328:x1875453495279488:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572140.517984:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572140.518006:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffef9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1102e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518078:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518092:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518130:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518146:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518153:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518160:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518457:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bfff0e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518468:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bfff0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518475:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bfff0e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572140.518485:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788572140.518932:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518941:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518949:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518955:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572140.518966:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518974:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518985:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:2.0:1788572140.518988:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572140.518992:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.518999:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.519011:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.519017:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.519022:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.519026:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0de00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572140.519029:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.519035:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.519042:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88c0593ef700) 00010000:00010000:2.0:1788572140.519044:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572140.519053:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.519057:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969bfff07 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.522705:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bffef9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1102e expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.522799:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bfff0e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1102e expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572140.522809:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:2.0:1788572140.522812:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572140.522816:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d400, rc 0) 00000100:00100000:2.0:1788572140.522957:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+15:11328:x1875453495279488:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4995us (5488us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788572140.522967:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:0.0:1788572140.553499:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572140.553743:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495279616 00000100:00100000:1.0:1788572140.553756:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495279616 00000100:00100000:3.0:1788572140.553802:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572140.553825:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:1.0:1788572140.553836:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+15:11328:x1875453495279616:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788572140.553873:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495279744 00000100:00100000:0.0:1788572140.553877:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495279744 00000100:00100000:1.0:1788572140.553950:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+16:11328:x1875453495279616:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 116us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572140.553958:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:3.0:1788572140.554004:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1788572140.554013:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+15:2354:x1875453495279744:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572140.554022:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572140.554118:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969bfff0e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1102e expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572140.554138:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:3.0:1788572140.554144:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572140.554175:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+14:2354:x1875453495279744:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 164us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572140.554183:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788572140.648656:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518359296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572140.648731:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572140.648925:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518359296 00000100:00100000:2.0:1788572140.648935:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518359296 00000100:00100000:2.0:1788572140.648997:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788572140.649007:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518359296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572140.649051:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572140.649403:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518359296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 397us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572140.649411:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788572140.660522:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518359296:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788572141.294090:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1788572141.295973:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788572141.480760:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788572141.480772:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788572141.481355:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1788572141.481365:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788572142.312809:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572142.815788:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572142.815884:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495279872 00000100:00100000:2.0:1788572142.815899:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495279872 00000100:00100000:2.0:1788572142.815992:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:2.0:1788572142.816025:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+13:11370:x1875453495279872:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572142.816055:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572142.816084:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bfff1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11035 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.816175:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.816195:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.816209:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.816229:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.816237:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.816279:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819016:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819039:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819047:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819067:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572142.819072:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819083:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819106:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:2.0:1788572142.819109:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572142.819116:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819123:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969bfff23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819138:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819145:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819151:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819157:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572142.819160:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819166:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819183:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88c0593ef700) 00010000:00010000:2.0:1788572142.819186:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572142.819190:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819196:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969bfff2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819687:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bfff1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11035 expref: 14 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819702:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:2.0:1788572142.819705:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572142.819709:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969bfff1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11035 expref: 14 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572142.819721:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00080000:1.0:1788572142.823776:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572142.827509:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+13:11370:x1875453495279872:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 11465us (11716us total) trans 0 rc 301/301 00000100:00100000:2.0:1788572142.827526:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:3.0:1788572142.837568:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572142.837616:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495280128 00000100:00100000:3.0:1788572142.837630:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495280128 00000100:00100000:3.0:1788572142.837708:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 140 00000100:00100000:3.0:1788572142.837721:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+13:11370:x1875453495280128:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:3.0:1788572142.837803:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572142.837852:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c046db2a00/0x977d9e7969bff89a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e6e expref: 13 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572142.837876:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:3.0:1788572142.837884:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572142.838390:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572142.838409:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11027 expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572142.838420:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572142.838467:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11027 expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572142.838487:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11027 expref: 5 pid: 5832 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572142.838509:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518359424:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572142.838643:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788572142.846176:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518359424:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572142.846224:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572142.851028:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572142.860868:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495280256 00000100:00100000:0.0:1788572142.860898:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495280256 00010000:00010000:1.0:1788572142.876002:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11027 expref: 6 pid: 5832 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572142.876075:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:1.0:1788572142.876090:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2356:x1875453495280256:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572142.876113:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572142.876122:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11027 expref: 6 pid: 5832 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876140:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11027 expref: 6 pid: 5832 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876170:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969bffef2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11027 expref: 6 pid: 5832 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876191:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:1.0:1788572142.876199:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876211:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876231:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876288:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572142.876383:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2356:x1875453495280256:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 297us (25372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572142.876392:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00080000:1.0:1788572142.876423:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572142.876441:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876450:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876482:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876494:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.876504:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572142.886070:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788572142.886103:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.886116:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.886125:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.886152:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572142.886158:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.886168:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.886191:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058eac300) 00010000:00010000:1.0:1788572142.886195:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572142.886201:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572142.886208:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff31 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572142.886232:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034364bcf reply state 00000000ad030bc6 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572142.886244:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572142.891104:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+14:11370:x1875453495280128:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 53369us (53537us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788572142.891120:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 140 00010000:00010000:0.0:1788572142.895914:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572142.895942:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572142.895951:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572142.895958:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572142.895964:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572142.895974:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572142.896001:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88c058eac900) 00010000:00010000:0.0:1788572142.896005:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572142.896011:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572142.896019:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969bfff38 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572143.009876:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572143.010123:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495280384 00000100:00100000:3.0:1788572143.010136:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495280384 00000100:00100000:3.0:1788572143.010217:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 141 00000100:00100000:3.0:1788572143.010229:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+13:11378:x1875453495280384:12345-192.168.202.2@tcp:101:lctl.0 00010000:00010000:3.0:1788572143.010319:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572143.010353:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bfff3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1103c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.010470:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bfff46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.010487:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bfff46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.010501:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bfff46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572143.010553:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572143.010558:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572143.010589:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bfff46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.010618:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bfff3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1103c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.010643:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bfff46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1103c expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.010653:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd600) 00010000:00010000:3.0:1788572143.010656:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572143.010662:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387000, rc 0) 00000100:00100000:3.0:1788572143.010754:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+14:11378:x1875453495280384:12345-192.168.202.2@tcp:101:lctl.0 Request processed in 526us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572143.010762:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 141 00000100:00100000:0.0:1788572143.071885:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572143.072040:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495280512 00000100:00100000:3.0:1788572143.072053:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495280512 00000100:00100000:3.0:1788572143.072216:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 142 00000100:00100000:3.0:1788572143.072228:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+14:11384:x1875453495280512:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788572143.072298:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572143.072330:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bfff4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11043 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.072703:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.072726:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.072741:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.072774:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.072782:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.072790:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.072928:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.072939:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.072947:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572143.072998:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788572143.073002:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572143.073028:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073043:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073050:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073059:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073065:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572143.073205:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073216:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073231:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd600) 00010000:00010000:3.0:1788572143.073234:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572143.073241:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073279:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfff54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073310:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073328:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073333:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073338:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572143.073341:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073348:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073356:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88c059bcd500) 00010000:00010000:3.0:1788572143.073359:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572143.073552:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073560:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfff5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073608:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bfff4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11043 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073624:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11043 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.073632:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572143.073635:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788572143.073645:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387400, rc 0) 00000100:00100000:3.0:1788572143.073742:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+15:11384:x1875453495280512:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1515us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572143.073752:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 142 00000100:00100000:2.0:1788572143.079000:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572143.079140:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495280768 00000100:00100000:0.0:1788572143.079186:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495280768 00000100:00100000:0.0:1788572143.079328:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 143 00000100:00100000:0.0:1788572143.079342:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+15:11384:x1875453495280768:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572143.079382:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572143.079717:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bfff69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1104a expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.079915:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.079935:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.079950:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.080093:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.080118:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.080131:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572143.084000:0:10431:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788572143.084267:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084288:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084332:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084378:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084386:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084392:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084397:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572143.084402:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084409:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084424:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:0.0:1788572143.084426:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572143.084432:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084438:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572143.084460:0:10431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072de2948 reply state 00000000a897d3e3 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572143.084469:0:10431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788572143.084517:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969bfff69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1104a expref: 18 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084535:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1104a expref: 17 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.084542:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf400) 00010000:00010000:0.0:1788572143.084545:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572143.084547:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b200, rc 0) 00000100:00100000:0.0:1788572143.084632:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+18:11384:x1875453495280768:12345-192.168.202.2@tcp:101:bash.0 Request processed in 5294us (5647us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788572143.084641:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 143 00000100:00100000:1.0:1788572143.094092:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572143.094657:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495280896 00000100:00100000:2.0:1788572143.094673:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495280896 00000100:00100000:2.0:1788572143.094790:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:2.0:1788572143.094806:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495280896:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572143.094832:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572143.094862:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11051 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572143.094919:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788572143.094946:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1788572143.094952:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572143.094964:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11051 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.094988:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11051 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.095017:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00080000:1.0:1788572143.095209:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572143.095329:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495280896:12345-192.168.202.2@tcp:101:bash.0 Request processed in 527us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572143.095338:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00010000:00010000:3.0:1788572143.103672:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.103704:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.103713:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.103719:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ae00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572143.103724:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.103733:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.103752:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0481bfb00) 00010000:00010000:3.0:1788572143.103756:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572143.103761:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.103767:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969bfff77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572143.103993:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572143.106315:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495281024 00000100:00100000:0.0:1788572143.106335:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495281024 00000100:00100000:0.0:1788572143.106451:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1788572143.106463:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:11384:x1875453495281024:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572143.106498:0:11678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572143.106531:0:11678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11058 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.106572:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11051 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.106583:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572143.106588:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572143.106594:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 7 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.106667:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11051 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.106685:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11051 expref: 7 pid: 6681 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572143.106702:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11678:1875453518359552:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572143.106839:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485389c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572143.115472:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572143.116173:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076235f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11678:1875453518359552:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572143.116223:0:11678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 7 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.116287:0:11678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a400, rc 0) 00000100:00100000:0.0:1788572143.116460:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:11384:x1875453495281024:12345-192.168.202.2@tcp:101:bash.0 Request processed in 9937us (12415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572143.116474:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:3.0:1788572143.119586:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495281152 00000100:00100000:3.0:1788572143.119602:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495281152 00010000:00010000:3.0:1788572143.119968:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11051 expref: 7 pid: 6681 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572143.120134:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:3.0:1788572143.120145:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495281152:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572143.120159:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572143.120181:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11051 expref: 7 pid: 6681 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.120196:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11051 expref: 7 pid: 6681 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.120219:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b62daa/0x977d9e7969bfff8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11051 expref: 7 pid: 6681 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.120275:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572143.120280:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572143.120288:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.120308:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.120357:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572143.120371:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5816:1875453518359680:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788572143.120451:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c05008a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572143.129310:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5816:1875453518359680:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788572143.129358:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572143.129442:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495281152:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 9297us (13981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572143.129456:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:1.0:1788572143.132435:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572143.132544:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495281408 00000100:00100000:0.0:1788572143.132563:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495281408 00000100:00100000:0.0:1788572143.132643:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:0.0:1788572143.132662:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+17:11384:x1875453495281408:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:0.0:1788572143.133097:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+18:11384:x1875453495281408:12345-192.168.202.2@tcp:35:bash.0 Request processed in 443us (676us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788572143.133105:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:1.0:1788572143.327677:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572143.327773:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495281664 00000100:00100000:0.0:1788572143.327784:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495281664 00000100:00100000:0.0:1788572143.327849:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 144 00000100:00100000:0.0:1788572143.327859:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+18:11394:x1875453495281664:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572143.327887:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572143.327923:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1105f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572143.328023:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788572143.328480:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1105f expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.328495:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd600) 00010000:00010000:0.0:1788572143.328498:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572143.328504:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969bfff9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1105f expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.328525:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b600, rc 0) 00000100:00100000:0.0:1788572143.328597:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+19:11394:x1875453495281664:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 739us (930us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788572143.328605:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 144 00000100:00100000:1.0:1788572143.339128:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572143.339305:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495281920 00000100:00100000:3.0:1788572143.339316:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495281920 00000100:00100000:3.0:1788572143.339381:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:3.0:1788572143.339392:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+19:11394:x1875453495281920:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788572143.339675:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+20:11394:x1875453495281920:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 285us (558us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788572143.339683:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00010000:00010000:0.0:1788572143.340926:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572143.488050:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572143.488152:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495282048 00000100:00100000:3.0:1788572143.488165:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495282048 00000100:00100000:3.0:1788572143.488242:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 145 00000100:00100000:3.0:1788572143.488299:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+20:11400:x1875453495282048:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788572143.488562:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572143.488590:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bfffa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11066 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.488666:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfffaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.488683:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfffaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.488720:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfffaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572143.488766:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788572143.488770:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572143.488793:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfffaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.488821:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bfffa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11066 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.488938:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfffaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11066 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.488948:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572143.488951:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572143.488955:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387200, rc 0) 00000100:00100000:3.0:1788572143.489068:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+21:11400:x1875453495282048:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 772us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572143.489076:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 145 00000100:00100000:1.0:1788572143.498967:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572143.499158:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495282304 00000100:00100000:3.0:1788572143.499169:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495282304 00000100:00100000:3.0:1788572143.499233:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00100000:3.0:1788572143.499243:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+21:11400:x1875453495282304:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788572143.499303:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572143.499324:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bfffb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1106d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.499441:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfffbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.499456:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfffbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.499469:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfffbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572143.499480:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788572143.499729:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969bfffb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1106d expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.499749:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfffbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1106d expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.499758:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf400) 00010000:00010000:3.0:1788572143.499761:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572143.499765:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386800, rc 0) 00000100:00100000:3.0:1788572143.499829:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+23:11400:x1875453495282304:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 587us (871us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788572143.499836:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00100000:1.0:1788572143.524154:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572143.524195:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572143.524214:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495282560 00000100:00100000:0.0:1788572143.524225:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495282560 00000100:00100000:1.0:1788572143.524408:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00100000:1.0:1788572143.524420:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+23:11400:x1875453495282560:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572143.524459:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572143.524485:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bfffcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11074 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572143.524597:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bfffd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572143.524610:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bfffd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572143.524620:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bfffd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572143.524629:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788572143.524747:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969bfffcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11074 expref: 26 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572143.524922:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bfffd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11074 expref: 25 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572143.524931:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf400) 00010000:00010000:1.0:1788572143.524934:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788572143.524937:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994600, rc 0) 00000100:00100000:1.0:1788572143.525008:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+25:11400:x1875453495282560:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 589us (860us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788572143.525015:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00100000:3.0:1788572143.525213:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495282688 00000100:00100000:3.0:1788572143.525220:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495282688 00000100:00100000:3.0:1788572143.525303:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1788572143.525313:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+25:2356:x1875453495282688:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572143.525323:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572143.525357:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969bfffbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1106d expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.525371:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf400) 00010000:00010000:3.0:1788572143.525375:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572143.525396:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+24:2356:x1875453495282688:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 87us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572143.525401:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1788572143.533544:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572143.533675:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495282816 00000100:00100000:2.0:1788572143.533688:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495282816 00000100:00100000:2.0:1788572143.533767:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788572143.533779:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495282816:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:2.0:1788572143.533828:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.533853:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.533862:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788572143.533873:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572143.533878:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.533920:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.533935:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 6 pid: 11678 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572143.533951:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1875453518359808:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572143.534188:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572143.541431:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572143.541684:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1875453518359808:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572143.541715:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572143.545197:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495282944 00000100:00100000:3.0:1788572143.545214:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495282944 00002000:00100000:3.0:1788572143.545445:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88bf46a67100 x1875453495282944/t0(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:559/0 lens 504/0 e 0 to 0 dl 1788572154 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788572143.545459:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bf46a67100 with x1875453495282944 ext(0->12) 00010000:00010000:3.0:1788572143.545472:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 7 pid: 11678 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.545492:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 7 pid: 11678 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572143.545501:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88bf46a67100 00000100:00100000:3.0:1788572143.545682:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:3.0:1788572143.545696:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495282944:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:3.0:1788572143.546301:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495282944:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 606us (4877us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788572143.546309:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00002000:00100000:3.0:1788572143.546317:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88bf46a67100 x1875453495282944/t4294967305(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:559/0 lens 504/448 e 0 to 0 dl 1788572154 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788572143.546404:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bf46a67100 with x1875453495282944 ext(0->12) 00010000:00010000:3.0:1788572143.546412:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 9 pid: 11678 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.546425:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 9 pid: 11678 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572143.546432:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88bf46a67100 00000100:00100000:0.0:1788572143.563516:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572143.563640:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495283072 00000100:00100000:3.0:1788572143.563651:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495283072 00010000:00010000:3.0:1788572143.563704:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 9 pid: 11678 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572143.563863:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:3.0:1788572143.563878:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:2355:x1875453495283072:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572143.563894:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788572143.563914:0:5815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788572143.563917:0:5815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788572143 00002000:00010000:3.0:1788572143.563920:0:5815:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788572143 00002000:00010000:3.0:1788572143.563922:0:5815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788572143 00010000:00010000:3.0:1788572143.563928:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 9 pid: 11678 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.563942:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 9 pid: 11678 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.563988:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969bfff93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11058 expref: 9 pid: 11678 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.565932:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572143.565942:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572143.565951:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.565965:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.566021:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572143.566242:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.566269:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.566313:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.566320:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.566341:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.566348:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572143.566354:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.566363:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.566377:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.566385:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd4d2c5/0x977d9e7969bfffe0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572143.566490:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495282816:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 32709us (32953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572143.566508:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:3.0:1788572143.568022:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076235f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495283072:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 4134us (4513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572143.571573:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:0.0:1788572143.573206:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572143.573799:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495283328 00000100:00100000:3.0:1788572143.573812:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495283328 00000100:00100000:3.0:1788572143.573878:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:3.0:1788572143.573890:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050314050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+24:11400:x1875453495283328:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:3.0:1788572143.573962:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bfffd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11074 expref: 24 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572143.575426:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788572143.575493:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788572143.581344:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788572143.581452:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.581474:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1104a expref: 28 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.581494:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.581658:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1104a expref: 28 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.581676:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1104a expref: 28 pid: 10431 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572143.581691:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1875453518359936:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572143.581925:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572143.600356:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572143.600482:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1875453518359936:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572143.600521:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572143.601623:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495283456 00000100:00100000:3.0:1788572143.601635:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495283456 00010000:00010000:3.0:1788572143.601696:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1104a expref: 29 pid: 10431 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572143.601744:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:3.0:1788572143.601762:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+29:2355:x1875453495283456:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572143.601776:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572143.601783:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1104a expref: 29 pid: 10431 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.601798:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1104a expref: 29 pid: 10431 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.601821:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969bfff7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1104a expref: 29 pid: 10431 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.601848:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf400) 00010000:00010000:3.0:1788572143.601854:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.601863:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.601871:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.601900:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572143.601960:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+28:2355:x1875453495283456:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 200us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572143.601967:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00010000:00010000:2.0:1788572143.602162:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.602172:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572143.602358:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788572143.602579:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788572143.602693:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518360064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788572143.602935:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572143.602969:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c06765ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572143.603428:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518360064 00000100:00100000:3.0:1788572143.603435:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518360064 00000100:00080000:0.0:1788572143.603589:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572143.603623:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788572143.603642:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875453518360064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788572143.603731:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875453518360064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572143.603739:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788572143.604294:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518360064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788572143.605449:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788572143.606422:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518360192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788572143.606491:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572143.606885:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572143.612258:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518360192 00000100:00100000:3.0:1788572143.612274:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518360192 00000100:00100000:2.0:1788572143.612447:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572143.612458:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875453518360192:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788572143.612748:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1875453518360192:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 292us (6257us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788572143.612756:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788572143.612860:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518360192:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788572143.612936:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788572143.612984:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.612994:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.613002:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.613008:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572143.613012:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.613020:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.613166:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf400) 00010000:00010000:3.0:1788572143.613171:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788572143.613176:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572143.613184:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969bfffe7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572143.613448:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788572143.613561:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788572143.613586:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364404336446ns, next at 365404334861ns, rc = 0 00000001:00080000:3.0:1788572143.613592:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788572143.613624:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf400) 00010000:00010000:3.0:1788572143.613627:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788572143.613634:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969bfffd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11074 expref: 32 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572143.613728:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050314050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+31:11400:x1875453495283328:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 39840us (40530us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788572143.613737:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000020:00080000:3.0:1788572143.613741:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788572143.627777:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572143.627865:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495283584 00000100:00100000:0.0:1788572143.627876:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495283584 00000100:00100000:0.0:1788572143.627939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 148 00000100:00100000:0.0:1788572143.627950:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+31:11400:x1875453495283584:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572143.627975:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572143.627997:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bfffee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1107b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.628072:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bfffee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1107b expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.628087:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bfffee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1107b expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.628108:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572143.628111:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572143.628115:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ba00, rc 0) 00000100:00100000:0.0:1788572143.628179:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+32:11400:x1875453495283584:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 231us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572143.628187:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 148 00000100:00100000:1.0:1788572143.631843:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572143.631949:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495283840 00000100:00100000:2.0:1788572143.631961:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495283840 00000100:00100000:2.0:1788572143.632020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1788572143.632148:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+32:11400:x1875453495283840:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572143.632535:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+33:11400:x1875453495283840:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 506us (701us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788572143.632552:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:1.0:1788572143.769707:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572143.769815:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495284096 00000100:00100000:2.0:1788572143.769825:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495284096 00000100:00100000:2.0:1788572143.769897:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 149 00000100:00100000:2.0:1788572143.769907:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+33:11410:x1875453495284096:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572143.769934:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572143.769965:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffff5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11082 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572143.770066:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788572143.770183:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffff5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11082 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.770210:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd600) 00010000:00010000:2.0:1788572143.770213:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572143.770219:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969bffff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11082 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.770233:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0da00, rc 0) 00000100:00100000:2.0:1788572143.770354:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+34:11410:x1875453495284096:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 448us (659us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788572143.770361:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 149 00000100:00100000:1.0:1788572143.777067:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572143.777151:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495284224 00000100:00100000:0.0:1788572143.777162:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495284224 00000100:00100000:0.0:1788572143.777225:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 150 00000100:00100000:0.0:1788572143.777289:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+34:11410:x1875453495284224:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1788572143.777372:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777392:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777405:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777422:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777429:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777437:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777548:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777556:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777563:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572143.777608:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777622:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777636:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777643:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777650:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ac00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572143.777655:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777664:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777811:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:0.0:1788572143.777815:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572143.777820:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777826:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c00003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777848:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777854:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777860:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777865:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024bc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572143.777875:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777881:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777889:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0481bf300) 00010000:00010000:0.0:1788572143.777892:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572143.777895:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777901:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0000a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777916:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777922:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777928:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777933:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024aa00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572143.777936:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777941:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777948:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572143.777949:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572143.777959:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.777965:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572143.778161:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+34:11410:x1875453495284224:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 908us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572143.778169:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 150 00000100:00100000:0.0:1788572143.783999:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572143.784138:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495284480 00000100:00100000:3.0:1788572143.784148:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495284480 00000100:00100000:3.0:1788572143.784296:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:3.0:1788572143.784309:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+34:11410:x1875453495284480:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788572143.784569:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+35:11410:x1875453495284480:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 262us (591us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788572143.784578:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:1.0:1788572143.855648:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572143.855863:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495284736 00000100:00100000:2.0:1788572143.855874:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495284736 00000100:00100000:2.0:1788572143.855938:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 151 00000100:00100000:2.0:1788572143.855950:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+35:11413:x1875453495284736:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572143.855975:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572143.856012:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c00018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11089 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.856350:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.856370:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.856383:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.856400:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.856425:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.856433:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.856579:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.856589:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.856595:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572143.856606:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788572143.857464:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857476:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857483:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857488:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572143.857492:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857501:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857529:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572143.857532:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572143.857538:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857545:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0001f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857560:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857567:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857572:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857577:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572143.857579:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857584:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857591:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef700) 00010000:00010000:2.0:1788572143.857593:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572143.857596:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857601:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.857660:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c00018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11089 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.860317:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11089 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572143.860331:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:2.0:1788572143.860333:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572143.860337:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c000, rc 0) 00000100:00100000:2.0:1788572143.860423:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+37:11413:x1875453495284736:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 4474us (4785us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788572143.860432:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 151 00000100:00100000:1.0:1788572143.873753:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572143.875633:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495284864 00000100:00100000:0.0:1788572143.875650:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495284864 00000100:00100000:0.0:1788572143.875744:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00100000:0.0:1788572143.875756:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+37:11413:x1875453495284864:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:0.0:1788572143.875853:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.875874:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.875887:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.875916:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.875923:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.875931:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.875969:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024bc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572143.875975:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.875983:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.875996:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572143.876000:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572143.876004:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572143.876012:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c0003b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572143.876112:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+37:11413:x1875453495284864:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 358us (2370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572143.876120:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00100000:0.0:1788572143.891344:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572143.891499:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495285120 00000100:00100000:2.0:1788572143.891510:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495285120 00000100:00100000:2.0:1788572143.891579:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:2.0:1788572143.891590:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+37:11413:x1875453495285120:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572143.891859:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+38:11413:x1875453495285120:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 271us (527us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788572143.891867:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:1.0:1788572144.292015:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572144.293081:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495285376 00000100:00100000:2.0:1788572144.293101:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495285376 00000100:00100000:2.0:1788572144.293195:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 153 00000100:00100000:2.0:1788572144.293206:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+38:11445:x1875453495285376:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:2.0:1788572144.293236:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572144.293330:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c00042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11090 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788572144.293472:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788572144.293802:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.293816:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.293829:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572144.293840:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788572144.293993:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c00042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11090 expref: 41 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.294014:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11090 expref: 40 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.294023:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:2.0:1788572144.294026:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572144.294030:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c200, rc 0) 00000100:00100000:2.0:1788572144.296054:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+40:11445:x1875453495285376:12345-192.168.202.2@tcp:101:cat.0 Request processed in 2834us (4032us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788572144.296066:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 153 00000100:00100000:1.0:1788572144.314874:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572144.314978:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572144.315083:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495285504 00000100:00100000:0.0:1788572144.315101:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495285504 00000100:00100000:0.0:1788572144.315179:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1788572144.315191:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+40:2356:x1875453495285504:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572144.315209:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572144.315235:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11090 expref: 40 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.315321:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572144.315327:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572144.315383:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+39:2356:x1875453495285504:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 193us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572144.315391:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1788572144.315646:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495285760 00000100:00100000:2.0:1788572144.315651:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495285760 00000100:00100000:2.0:1788572144.315690:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:2.0:1788572144.315698:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+39:11445:x1875453495285760:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:2.0:1788572144.315924:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+40:11445:x1875453495285760:12345-192.168.202.2@tcp:35:cat.0 Request processed in 226us (945us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788572144.315938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00010000:00010000:3.0:1788572144.360836:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572144.393647:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572144.393748:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495286016 00000100:00100000:1.0:1788572144.393761:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495286016 00000100:00100000:1.0:1788572144.393828:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 154 00000100:00100000:1.0:1788572144.393840:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+40:11451:x1875453495286016:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:1.0:1788572144.393870:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572144.393874:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788572144.393902:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969bfffaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11066 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.393924:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:1.0:1788572144.393929:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572144.393945:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00057 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11097 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.394045:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.394061:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11089 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.394591:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.394629:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11089 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.394644:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11089 expref: 40 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572144.394659:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518360320:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572144.394758:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572144.407223:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518360320:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572144.407305:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572144.407504:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572144.408008:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495286144 00000100:00100000:3.0:1788572144.408017:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495286144 00010000:00010000:3.0:1788572144.408059:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11089 expref: 41 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572144.408191:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:3.0:1788572144.408202:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+41:2356:x1875453495286144:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572144.408218:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572144.408242:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11089 expref: 41 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.408295:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11089 expref: 41 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.408319:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c0002d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11089 expref: 41 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.408337:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:3.0:1788572144.408342:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.408352:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.408360:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.408506:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572144.408574:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+40:2356:x1875453495286144:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 372us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572144.408582:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00010000:00010000:0.0:1788572144.408641:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.408649:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572144.408667:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788572144.408827:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00057 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11097 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.408843:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11097 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.408851:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572144.408854:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788572144.408857:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995a00, rc 0) 00000100:00100000:0.0:1788572144.408881:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+40:11451:x1875453495286016:12345-192.168.202.2@tcp:101:dd.0 Request processed in 15045us (15246us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788572144.408895:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 154 00000100:00100000:0.0:1788572144.414832:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572144.414911:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495286400 00000100:00100000:3.0:1788572144.414922:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495286400 00000100:00100000:3.0:1788572144.414986:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 155 00000100:00100000:3.0:1788572144.414998:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+40:11451:x1875453495286400:12345-192.168.202.2@tcp:36:dd.0 00010000:00010000:3.0:1788572144.415362:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.415414:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.415428:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572144.415503:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788572144.415530:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fb5ba13 reply state 000000008134a5c0 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572144.415539:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572144.415646:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+43:11451:x1875453495286400:12345-192.168.202.2@tcp:36:dd.0 Request processed in 649us (827us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788572144.415654:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 155 00000020:00080000:3.0:1788572144.415659:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788572144.418172:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.418191:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.418199:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.418205:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572144.418210:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.418219:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.418239:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572144.418243:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572144.418300:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572144.418308:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0006c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572144.744962:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518360704:0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.745039:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572144.745119:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572144.745126:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518360832:0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.745154:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572144.745191:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518360832 00000100:00100000:3.0:1788572144.745199:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518360832 00000100:00100000:3.0:1788572144.745319:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788572144.745330:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518360832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.745397:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518360832:12345-0@lo:400:kworker.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572144.745404:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788572144.745427:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572144.745475:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518360576:0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.745480:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518360832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572144.745514:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572144.745536:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518361088:0@lo:400:kworker.0 00000100:00100000:1.0:1788572144.745576:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572144.745603:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788572144.745609:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518360448:0@lo:400:kworker.0 00000100:00100000:1.0:1788572144.745635:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572144.745658:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518360960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572144.745678:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572144.745699:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518360448 00000100:00100000:3.0:1788572144.745704:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518360448 00000100:00100000:1.0:1788572144.745714:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518360704 00000100:00100000:1.0:1788572144.745720:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518360704 00000100:00080000:1.0:1788572144.745742:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572144.745752:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788572144.745762:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518360448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572144.745772:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518360576 00000100:00100000:1.0:1788572144.745783:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518360576 00000100:00100000:1.0:1788572144.745804:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518360960 00000100:00100000:1.0:1788572144.745806:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518360960 00000100:00100000:3.0:1788572144.745811:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518360448:12345-0@lo:400:kworker.0 Request processed in 49us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572144.745819:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:1.0:1788572144.745824:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572144.745840:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788572144.745847:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518360704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572144.745884:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518360704:12345-0@lo:400:kworker.0 Request processed in 38us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572144.745890:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788572144.745921:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518360704:0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.745936:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518361088 00000100:00100000:3.0:1788572144.745942:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518361088 00000100:00100000:1.0:1788572144.745948:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788572144.745957:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518360576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.745971:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788572144.745982:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518361088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572144.745991:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518360576:12345-0@lo:400:kworker.0 Request processed in 35us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572144.745999:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788572144.746017:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788572144.746022:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518361088:12345-0@lo:400:kworker.0 Request processed in 42us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572144.746028:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518360960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.746033:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788572144.746064:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518360448:0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.746078:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c555f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518360960:0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.746087:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518360576:0@lo:400:kworker.0 00000100:00100000:3.0:1788572144.746097:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518361088:0@lo:400:kworker.0 00000100:00100000:1.0:1788572144.746198:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518360960:12345-0@lo:400:kworker.0 Request processed in 173us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572144.746205:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788572144.801880:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572144.802012:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495286528 00000100:00100000:1.0:1788572144.802026:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495286528 00000100:00100000:1.0:1788572144.802148:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 156 00000100:00100000:1.0:1788572144.802160:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+42:11465:x1875453495286528:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:1.0:1788572144.802188:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572144.802213:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00073 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1109e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.802345:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.802362:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.802374:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.802388:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.802395:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.802401:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.802949:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.802965:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11097 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.802973:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.803024:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11097 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572144.803052:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11097 expref: 43 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572144.803067:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518361216:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572144.803168:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572144.808186:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04754d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518361216:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572144.808217:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572144.809295:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572144.809379:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495286784 00000100:00100000:2.0:1788572144.809388:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495286784 00000100:00100000:2.0:1788572144.809444:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1788572144.809455:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+44:5594:x1875453495286784:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788572144.809858:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+45:5594:x1875453495286784:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 404us (623us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788572144.809866:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1788572144.815138:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572144.815311:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495286912 00000100:00100000:3.0:1788572144.815322:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495286912 00010000:00010000:3.0:1788572144.815362:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11097 expref: 45 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572144.815396:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:3.0:1788572144.815421:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+45:2356:x1875453495286912:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572144.815437:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572144.815443:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11097 expref: 45 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.815456:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11097 expref: 45 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.815493:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c0005e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11097 expref: 45 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.815511:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:3.0:1788572144.815515:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.815524:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.815532:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.815567:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572144.816023:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816033:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572144.816082:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788572144.816087:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572144.816109:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816123:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816133:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816141:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816147:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816161:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572144.816166:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816174:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816185:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572144.816187:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572144.816192:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816199:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c0007a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816211:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816217:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816222:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816226:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572144.816229:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816234:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816309:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c058eac300) 00010000:00010000:2.0:1788572144.816312:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572144.816316:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816322:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816363:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00073 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1109e expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816377:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1109e expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.816384:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:2.0:1788572144.816387:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572144.816389:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994800, rc 0) 00000100:00100000:3.0:1788572144.816736:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+44:2356:x1875453495286912:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 1314us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572144.816745:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:2.0:1788572144.819970:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+43:11465:x1875453495286528:12345-192.168.202.2@tcp:101:stat.0 Request processed in 17798us (18088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572144.819984:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 156 00000100:00100000:0.0:1788572144.941529:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572144.941714:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495287168 00000100:00100000:2.0:1788572144.941724:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495287168 00000100:00100000:2.0:1788572144.941785:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 157 00000100:00100000:2.0:1788572144.941795:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+43:11471:x1875453495287168:12345-192.168.202.2@tcp:36:truncate.0 00010000:00010000:2.0:1788572144.941862:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572144.941893:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1109e expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.941934:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:2.0:1788572144.941940:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572144.942171:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.942184:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572144.942193:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572144.942535:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788572144.942566:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ba611bd reply state 00000000fd9a0464 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572144.942576:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572144.942751:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+45:11471:x1875453495287168:12345-192.168.202.2@tcp:36:truncate.0 Request processed in 956us (1231us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788572144.942760:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 157 00000020:00080000:2.0:1788572144.942765:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788572144.945625:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.945646:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.945669:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.945675:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572144.945680:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.945688:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.945709:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:3.0:1788572144.945713:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572144.945718:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572144.945726:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0008f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572144.982216:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572144.982337:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572144.982382:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572144.982420:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572144.982603:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495287424 00000100:00100000:1.0:1788572144.982612:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495287424 00000100:00100000:1.0:1788572144.982670:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495287552 00000100:00100000:1.0:1788572144.982674:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495287552 00000100:00100000:1.0:1788572144.982698:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:1.0:1788572144.982708:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495287424:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572144.982786:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2355:x1875453495287424:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 79us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572144.982793:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:1.0:1788572144.982811:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:1.0:1788572144.982817:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495287552:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572144.982841:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495287552:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572144.982847:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00080000:0.0:1788572144.983406:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572144.983483:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495287296 00000100:00100000:2.0:1788572144.983490:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495287296 00000100:00100000:2.0:1788572144.983533:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 300 00000100:00100000:2.0:1788572144.983542:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495287296:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572144.983587:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495287296:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 46us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572144.983605:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 300 00000100:00100000:2.0:1788572144.983669:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495287680 00000100:00100000:2.0:1788572144.983683:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495287680 00000100:00080000:2.0:1788572144.983702:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572144.983728:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:2.0:1788572144.983735:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2355:x1875453495287680:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572144.983769:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2355:x1875453495287680:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 34us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572144.983776:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:1.0:1788572145.117091:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572145.117206:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495287808 00000100:00100000:2.0:1788572145.117216:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495287808 00000100:00100000:2.0:1788572145.117317:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 158 00000100:00100000:2.0:1788572145.117330:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+44:11485:x1875453495287808:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:2.0:1788572145.117355:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572145.117379:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00096 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117455:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117482:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117493:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117510:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117518:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117538:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117642:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117651:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117658:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572145.117698:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788572145.117703:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572145.117723:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117736:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117743:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117749:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117756:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117762:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572145.117766:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117786:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117798:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572145.117801:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572145.117805:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117812:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0009d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117825:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117832:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117838:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117843:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572145.117846:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117852:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117858:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef700) 00010000:00010000:2.0:1788572145.117861:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572145.117863:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117878:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117914:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00096 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110a5 expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117928:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110a5 expref: 45 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.117935:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:2.0:1788572145.117937:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572145.117939:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c400, rc 0) 00000100:00100000:2.0:1788572145.118012:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+45:11485:x1875453495287808:12345-192.168.202.2@tcp:101:stat.0 Request processed in 684us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572145.118019:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 158 00000100:00100000:2.0:1788572145.234405:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572145.234529:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495288064 00000100:00100000:0.0:1788572145.234541:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495288064 00000100:00100000:0.0:1788572145.234617:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 159 00000100:00100000:0.0:1788572145.234629:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+45:11495:x1875453495288064:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572145.234652:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572145.234678:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c000b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110ac expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572145.234776:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788572145.234919:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c000b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110ac expref: 47 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.234933:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd600) 00010000:00010000:0.0:1788572145.234937:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572145.234943:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c000b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110ac expref: 47 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.234968:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ae00, rc 0) 00000100:00100000:0.0:1788572145.235041:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+46:11495:x1875453495288064:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 414us (649us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788572145.235049:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 159 00000100:00100000:3.0:1788572145.239297:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572145.240533:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495288320 00000100:00100000:2.0:1788572145.240550:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495288320 00000100:00100000:2.0:1788572145.240631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:2.0:1788572145.240642:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050314450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+46:11495:x1875453495288320:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572145.240927:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050314450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+47:11495:x1875453495288320:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 286us (1640us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788572145.240935:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000004:00080000:0.0:1788572145.256888:0:8034:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366047635481ns, next at 367047632782ns, rc = 0 00000100:00100000:3.0:1788572145.256952:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572145.256980:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518361344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572145.257059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572145.257180:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518361344 00000100:00100000:0.0:1788572145.257188:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518361344 00000100:00100000:0.0:1788572145.257279:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788572145.257305:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518361344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572145.257340:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572145.257391:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1875453518361344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572145.257400:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788572145.257454:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518361344:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572145.257888:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572145.317236:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572145.319750:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495288576 00000100:00100000:2.0:1788572145.319767:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495288576 00000100:00100000:2.0:1788572145.319867:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 160 00000100:00100000:2.0:1788572145.319878:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+47:11501:x1875453495288576:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572145.319905:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572145.319928:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c000c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.320033:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.320048:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110a5 expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.320058:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.320095:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110a5 expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.320110:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110a5 expref: 48 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572145.320123:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518361472:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572145.320238:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c06765ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572145.327033:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572145.327120:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495288704 00000100:00100000:3.0:1788572145.327135:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495288704 00010000:00010000:3.0:1788572145.327177:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110a5 expref: 49 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572145.327225:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:3.0:1788572145.327283:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+49:2355:x1875453495288704:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572145.327316:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572145.327324:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110a5 expref: 49 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.327337:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110a5 expref: 49 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.327483:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:3.0:1788572145.327489:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.327498:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.327505:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.327524:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572145.327618:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+49:2355:x1875453495288704:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 371us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572145.327626:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00010000:00010000:2.0:1788572145.327677:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c000ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110a5 expref: 48 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572145.327698:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518361472:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572145.327720:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.327738:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.327744:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572145.327762:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788572145.327913:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c000c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110b3 expref: 49 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.327929:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110b3 expref: 48 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.327937:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:2.0:1788572145.327940:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572145.327943:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0cc00, rc 0) 00000100:00100000:2.0:1788572145.327973:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+48:11501:x1875453495288576:12345-192.168.202.2@tcp:101:bash.0 Request processed in 8098us (10761us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788572145.327980:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 160 00000100:00100000:1.0:1788572145.331842:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572145.332093:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495288960 00000100:00100000:0.0:1788572145.332104:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495288960 00000100:00100000:0.0:1788572145.332168:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 161 00000100:00100000:0.0:1788572145.332180:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+48:11501:x1875453495288960:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:0.0:1788572145.332524:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.332542:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.332555:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572145.332607:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788572145.332631:0:10431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d39be1c reply state 000000009f19c637 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572145.332640:0:10431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572145.332735:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+51:11501:x1875453495288960:12345-192.168.202.2@tcp:36:bash.0 Request processed in 557us (904us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788572145.332742:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 161 00000020:00080000:0.0:1788572145.332747:0:10431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788572145.336207:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.336225:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.336281:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.336288:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572145.336293:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.336302:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.336319:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:1.0:1788572145.336322:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572145.336327:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.336334:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572145.346838:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572145.347001:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495289088 00000100:00100000:0.0:1788572145.347011:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495289088 00000100:00100000:0.0:1788572145.347069:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 162 00000100:00100000:0.0:1788572145.347078:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+50:11501:x1875453495289088:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572145.347104:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572145.347125:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110ba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.347211:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.347225:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110b3 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.347280:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.347316:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110b3 expref: 51 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.347331:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110b3 expref: 51 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572145.347519:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518361600:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572145.347610:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059eeaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572145.360236:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572145.360396:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518361600:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572145.360427:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572145.360657:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495289216 00000100:00100000:3.0:1788572145.360664:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495289216 00010000:00010000:3.0:1788572145.360700:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110b3 expref: 52 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572145.360739:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:3.0:1788572145.360749:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+52:2356:x1875453495289216:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572145.360780:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572145.360788:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110b3 expref: 52 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.360800:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110b3 expref: 52 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.360821:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c000c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110b3 expref: 52 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.360837:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:3.0:1788572145.360842:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.360852:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.360861:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.360893:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572145.360949:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+51:2356:x1875453495289216:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 201us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572145.360956:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00010000:00010000:2.0:1788572145.361582:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.361593:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572145.361652:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788572145.361657:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572145.361677:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.361710:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110ba expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.361734:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110ba expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.361742:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:2.0:1788572145.361745:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572145.361748:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b000, rc 0) 00000100:00100000:2.0:1788572145.361784:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+50:11501:x1875453495289088:12345-192.168.202.2@tcp:101:bash.0 Request processed in 14706us (14955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572145.361791:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 162 00000100:00100000:1.0:1788572145.368564:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572145.368934:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495289472 00000100:00100000:2.0:1788572145.368946:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495289472 00000100:00100000:2.0:1788572145.369064:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:2.0:1788572145.369075:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+50:11501:x1875453495289472:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:2.0:1788572145.369377:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+51:11501:x1875453495289472:12345-192.168.202.2@tcp:35:bash.0 Request processed in 303us (824us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788572145.369385:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00010000:00010000:0.0:1788572145.384819:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572145.477699:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572145.477838:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495289728 00000100:00100000:0.0:1788572145.477850:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495289728 00000100:00100000:0.0:1788572145.477965:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 163 00000100:00100000:0.0:1788572145.477975:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+51:11511:x1875453495289728:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572145.477999:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572145.478022:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a600/0x977d9e7969c000ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110c1 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572145.478111:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788572145.478291:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a600/0x977d9e7969c000ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110c1 expref: 53 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.478305:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd600) 00010000:00010000:0.0:1788572145.478308:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572145.478314:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a600/0x977d9e7969c000ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110c1 expref: 53 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.478333:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a600, rc 0) 00000100:00100000:0.0:1788572145.478402:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+52:11511:x1875453495289728:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 428us (712us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788572145.478408:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 163 00000100:00100000:3.0:1788572145.482375:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572145.492706:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495289856 00000100:00100000:2.0:1788572145.492723:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495289856 00000100:00100000:0.0:1788572145.497122:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 164 00000100:00100000:0.0:1788572145.497154:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+52:11511:x1875453495289856:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1788572145.497513:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497532:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497545:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497574:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497582:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497589:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497680:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497691:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497697:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572145.497740:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497978:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497985:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497991:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.497997:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572145.498001:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498018:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498031:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:0.0:1788572145.498034:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572145.498039:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498045:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a800/0x977d9e7969c000f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498067:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498073:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498080:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498085:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572145.498088:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498094:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498100:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0481bf300) 00010000:00010000:0.0:1788572145.498102:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572145.498105:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498121:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c000ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498139:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498146:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498152:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498156:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ae00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572145.498159:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498164:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498172:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572145.498175:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572145.498177:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.498182:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572145.498542:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+52:11511:x1875453495289856:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 1401us (16173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572145.498552:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 164 00000100:00100000:1.0:1788572145.501525:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572145.501623:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495290112 00000100:00100000:0.0:1788572145.501633:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495290112 00000100:00100000:0.0:1788572145.501724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1788572145.501734:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+52:11511:x1875453495290112:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788572145.501983:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+53:11511:x1875453495290112:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 249us (761us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788572145.501991:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:1.0:1788572145.548824:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572145.548959:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495290368 00000100:00100000:2.0:1788572145.548969:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495290368 00000100:00100000:2.0:1788572145.549033:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 165 00000100:00100000:2.0:1788572145.549043:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+53:11514:x1875453495290368:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572145.549066:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572145.549089:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0010d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110c8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.549187:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.549203:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.549215:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.549317:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.549326:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572145.549333:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549769:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549780:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549796:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572145.549807:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788572145.549898:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549906:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549914:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549920:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572145.549925:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549932:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549944:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572145.549947:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572145.549952:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549959:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00114 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549973:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549978:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549989:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.549994:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572145.549997:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.550003:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.550011:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef700) 00010000:00010000:3.0:1788572145.550013:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572145.550015:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.550020:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0011b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.550064:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0010d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110c8 expref: 56 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.550079:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110c8 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572145.550087:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:3.0:1788572145.550089:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572145.550091:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387a00, rc 0) 00000100:00100000:3.0:1788572145.550165:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+55:11514:x1875453495290368:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1122us (1356us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788572145.550183:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 165 00000100:00100000:3.0:1788572145.557359:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572145.557581:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495290496 00000100:00100000:1.0:1788572145.557591:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495290496 00000100:00100000:1.0:1788572145.557648:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:1.0:1788572145.557658:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+55:11514:x1875453495290496:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:1.0:1788572145.557757:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.557775:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.557787:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.557814:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.557821:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.557828:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.557834:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572145.557838:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.557846:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.557861:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:1.0:1788572145.557864:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572145.557869:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.557889:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572145.557983:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+55:11514:x1875453495290496:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 325us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572145.557991:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:2.0:1788572145.561194:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572145.563979:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495290624 00000100:00100000:0.0:1788572145.564000:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495290624 00000100:00100000:1.0:1788572145.564141:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572145.564152:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+55:2354:x1875453495290624:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572145.564167:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572145.564193:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110c8 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.564213:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:1.0:1788572145.564218:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572145.564722:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+54:2354:x1875453495290624:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 568us (3535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572145.564731:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788572145.566883:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572145.566963:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495290880 00000100:00100000:1.0:1788572145.566974:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495290880 00000100:00100000:1.0:1788572145.567032:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:1.0:1788572145.567042:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+54:11514:x1875453495290880:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572145.567333:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+55:11514:x1875453495290880:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 291us (458us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788572145.567553:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:3.0:1788572145.717568:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572145.717687:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495291136 00000100:00100000:1.0:1788572145.717711:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495291136 00000100:00100000:1.0:1788572145.717776:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:1.0:1788572145.717787:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+55:11532:x1875453495291136:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:1.0:1788572145.717815:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572145.717842:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00137 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.717970:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0013e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.717986:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0013e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.717998:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0013e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572145.718009:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788572145.718478:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00137 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110cf expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.718498:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0013e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110cf expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.718508:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:1.0:1788572145.718511:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788572145.718514:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994600, rc 0) 00000100:00100000:1.0:1788572145.718623:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+57:11532:x1875453495291136:12345-192.168.202.2@tcp:101:cat.0 Request processed in 836us (1066us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788572145.718631:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:2.0:1788572145.746038:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572145.746633:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495291264 00000100:00100000:1.0:1788572145.746645:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495291264 00000100:00100000:1.0:1788572145.746715:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 168 00000100:00100000:1.0:1788572145.746727:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+57:11533:x1875453495291264:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572145.746752:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572145.746771:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0014c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.746834:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.746848:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.746860:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572145.746892:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788572145.746896:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572145.746912:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.746937:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0014c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110d6 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.746957:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110d6 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.746966:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:1.0:1788572145.746969:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572145.746987:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994a00, rc 0) 00000100:00100000:1.0:1788572145.747060:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+58:11533:x1875453495291264:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 335us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572145.747066:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 168 00000100:00100000:2.0:1788572145.753935:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572145.754181:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495291648 00000100:00100000:0.0:1788572145.754191:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495291648 00000100:00100000:0.0:1788572145.754733:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1788572145.754746:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+58:11533:x1875453495291648:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788572145.755341:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+59:11533:x1875453495291648:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 587us (1407us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788572145.755351:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:3.0:1788572145.759675:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572145.759886:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495291776 00000100:00100000:0.0:1788572145.759896:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495291776 00000100:00100000:0.0:1788572145.759963:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:0.0:1788572145.759975:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+59:11533:x1875453495291776:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:0.0:1788572145.759991:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788572145.760017:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c000e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110ba expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.760048:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0013e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110cf expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.760086:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969bfffee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1107b expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572145.760099:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572145.760110:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572145.760370:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+56:11533:x1875453495291776:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 397us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572145.760378:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788572145.765190:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572145.765361:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495291904 00000100:00100000:1.0:1788572145.765375:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495291904 00000100:00100000:1.0:1788572145.765461:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 169 00000100:00100000:1.0:1788572145.765473:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+56:11533:x1875453495291904:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:1.0:1788572145.765591:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.765609:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.765621:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572145.765818:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788572145.765909:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+56:11533:x1875453495291904:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 438us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572145.765918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 169 00000100:00100000:1.0:1788572145.769728:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572145.769757:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518361728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572145.769863:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572145.769995:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518361728 00000100:00100000:3.0:1788572145.770004:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518361728 00000100:00100000:3.0:1788572145.770056:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788572145.770067:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518361728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572145.770102:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572145.770162:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518361728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572145.770169:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788572145.770644:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518361728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572145.808146:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572145.808476:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495292032 00000100:00100000:1.0:1788572145.808489:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495292032 00000100:00100000:1.0:1788572145.808563:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 170 00000100:00100000:1.0:1788572145.808574:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+56:11535:x1875453495292032:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572145.808609:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572145.808630:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808699:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808714:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808727:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808741:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808748:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808755:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808845:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808853:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808859:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572145.808896:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788572145.808908:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572145.808929:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808942:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808949:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808955:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808961:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808966:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572145.808971:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808979:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.808991:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:1.0:1788572145.808994:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572145.808999:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809005:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c00168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809018:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809035:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809040:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809045:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572145.809049:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809055:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809062:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c058eac900) 00010000:00010000:1.0:1788572145.809065:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572145.809068:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809073:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c0016f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809108:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110dd expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809120:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110dd expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572145.809127:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c058eac400) 00010000:00010000:1.0:1788572145.809129:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572145.809137:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994800, rc 0) 00000100:00100000:1.0:1788572145.809227:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+57:11535:x1875453495292032:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 644us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572145.809234:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 170 00000001:00080000:2.0:1788572146.394103:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1788572146.394137:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1788572146.396074:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572146.396098:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518361856:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572146.396180:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572146.396446:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518361856 00000100:00100000:3.0:1788572146.396454:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518361856 00000100:00100000:3.0:1788572146.396676:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788572146.396689:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518361856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572146.396728:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788572146.396906:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b71ef, atime: 0x6a9b71ef, ctime: 0x6a9b71ef, blocks: 0x1 00010000:00010000:3.0:1788572146.396915:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.396932:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788572146.396938:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572146.396946:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.396976:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.396988:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.396997:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.397023:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572146.397229:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572146.397238:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.397275:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572146.397280:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.397290:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.397308:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.397328:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000013a8bee/0x977d9e7969c0017d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.397348:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.397350:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572146.397351:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788572146.397618:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c0537f76c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788572146.397625:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c051327e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c0537f7840 00000020:00080000:2.0:1788572146.397629:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c051327600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c052e6d400 00000004:00080000:2.0:1788572146.397665:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788572146.397735:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788572146.397923:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788572146.398133:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1875453518361856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1445us (1950us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788572146.398144:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1788572146.398177:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c04a09e680/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788572146.398185:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518361856:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572146.409673:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572146.607223:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572146.607437:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572146.607492:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788572146.607498:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788572146.607631:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd12d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518361984:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572146.607732:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572146.613464:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572146.613501:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495292160 00000100:00100000:2.0:1788572146.613509:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495292160 00000100:00100000:2.0:1788572146.613568:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:2.0:1788572146.613578:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495292160:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788572146.613611:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788572146.613723:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495292160:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 146us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572146.613731:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00080000:2.0:1788572146.613755:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572146.616413:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd12d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518361984:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788572146.621886:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572146.622058:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495292288 00000100:00100000:3.0:1788572146.622073:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495292288 00000100:00100000:3.0:1788572146.622142:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:3.0:1788572146.622153:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+16:11546:x1875453495292288:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788572146.622723:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622758:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622771:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622805:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622813:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622820:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622848:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622857:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622864:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572146.622907:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788572146.622912:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572146.622927:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622938:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.622945:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623019:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623095:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572146.623101:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623109:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623122:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:3.0:1788572146.623125:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572146.623130:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623137:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00184 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623151:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623157:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623162:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623167:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572146.623169:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623175:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623381:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff88c059bcdf00) 00010000:00010000:3.0:1788572146.623385:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572146.623389:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623396:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c0018b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623413:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623420:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623426:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623431:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572146.623434:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623439:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623446:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c058eac400) 00010000:00010000:3.0:1788572146.623449:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572146.623452:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.623457:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572146.623555:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+16:11546:x1875453495292288:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 1401us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572146.623564:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:3.0:1788572146.627509:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572146.627585:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495292544 00000100:00100000:1.0:1788572146.627595:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495292544 00000100:00100000:1.0:1788572146.627655:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 173 00000100:00100000:1.0:1788572146.627667:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+16:11546:x1875453495292544:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572146.627688:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572146.627711:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c00199 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110e4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.627834:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.627851:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.627863:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572146.627875:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788572146.628096:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.628111:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.628118:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.628123:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572146.628127:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.628135:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.628148:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c058eac400) 00010000:00010000:1.0:1788572146.628152:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572146.628157:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.628164:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.628225:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c00199 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110e4 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.628564:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:1.0:1788572146.628567:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572146.628572:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c00199 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110e4 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.628582:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994200, rc 0) 00000100:00100000:1.0:1788572146.631059:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495292544:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 3380us (3547us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1788572146.631072:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 173 00000100:00100000:0.0:1788572146.652000:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572146.652266:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495292672 00000100:00100000:2.0:1788572146.652277:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495292672 00000100:00100000:2.0:1788572146.652343:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:2.0:1788572146.652354:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495292672:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788572146.652404:0:10431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788572146.652538:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495292672:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 185us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572146.652546:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:2.0:1788572146.664906:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572146.666562:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495292928 00000100:00100000:3.0:1788572146.666577:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495292928 00000100:00100000:3.0:1788572146.666640:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:3.0:1788572146.666649:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495292928:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572146.666669:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572146.666672:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788572146.666697:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110d6 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.666714:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572146.666720:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572146.666733:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c001ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110eb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572146.667580:0:5830:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788572146.667849:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c001b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.667867:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c001b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.667878:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c001b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.667946:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c001ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110eb expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.667962:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c001b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110eb expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.667970:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c059bcdf00) 00010000:00010000:3.0:1788572146.667972:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572146.667975:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041386800, rc 0) 00000100:00100000:3.0:1788572146.668047:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+18:11546:x1875453495292928:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1398us (3151us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788572146.668056:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:0.0:1788572146.675970:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572146.676242:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495293184 00000100:00100000:2.0:1788572146.676272:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495293184 00000100:00100000:2.0:1788572146.676335:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 176 00000100:00100000:2.0:1788572146.676346:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+18:11546:x1875453495293184:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788572146.676409:0:10431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572146.676456:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c001b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110eb expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.676477:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c059bcdf00) 00010000:00010000:2.0:1788572146.676497:0:10431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572146.676520:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.676533:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.676544:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.676669:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.676678:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.676685:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677101:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677122:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677129:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677135:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572146.677140:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677148:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677159:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572146.677162:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572146.677166:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677172:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c001c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677182:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677198:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677206:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.677211:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ca00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572146.677220:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.678764:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.678783:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb43d58ee (ffff88c0593efc00) 00010000:00010000:2.0:1788572146.678786:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572146.678791:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.678798:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb43d58ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572146.680673:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495293184:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 4316us (4709us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572146.680687:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 176 00000100:00100000:2.0:1788572146.690008:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572146.691078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495293312 00000100:00100000:0.0:1788572146.691090:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495293312 00000100:00100000:0.0:1788572146.691153:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 177 00000100:00100000:0.0:1788572146.691164:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495293312:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572146.691185:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572146.691222:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c001d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.691280:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.691296:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.691316:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.691399:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c001d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f2 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.691421:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.691430:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572146.691433:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788572146.691437:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b200, rc 0) 00000100:00100000:0.0:1788572146.691498:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+18:11546:x1875453495293312:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 336us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572146.691505:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 177 00000100:00100000:0.0:1788572146.704392:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572146.704926:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495293568 00000100:00100000:2.0:1788572146.704938:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495293568 00000100:00100000:2.0:1788572146.705005:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 178 00000100:00100000:2.0:1788572146.705017:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+18:11546:x1875453495293568:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788572146.705112:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.705132:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.705145:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572146.705595:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788572146.705605:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367496355749ns, next at 368496353754ns, rc = 0 00000004:00010000:2.0:1788572146.705695:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000315f7369 reply state 00000000641288de transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572146.705705:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572146.705814:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+20:11546:x1875453495293568:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 792us (1424us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788572146.705822:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 178 00010000:00010000:2.0:1788572146.710793:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.710813:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.710822:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.710828:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ca00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572146.710835:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.710844:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.710862:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:2.0:1788572146.710866:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572146.710871:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.710888:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c001df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572146.712536:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572146.712584:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495293696 00000100:00100000:1.0:1788572146.712595:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495293696 00000100:00100000:1.0:1788572146.712663:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 179 00000100:00100000:1.0:1788572146.712673:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+19:11546:x1875453495293696:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572146.712699:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572146.712720:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb110f9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.712786:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f9 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.712799:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f9 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572146.712819:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:1.0:1788572146.712822:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572146.712825:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995200, rc 0) 00000100:00100000:1.0:1788572146.712882:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+20:11546:x1875453495293696:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 209us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572146.712889:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 179 00000100:00100000:1.0:1788572146.717551:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572146.717658:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495293824 00000100:00100000:3.0:1788572146.717670:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495293824 00000100:00100000:3.0:1788572146.717743:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:3.0:1788572146.717753:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495293824:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788572146.718182:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495293824:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 428us (643us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788572146.718201:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00080000:1.0:1788572146.718307:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572146.726691:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572146.728107:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495294080 00000100:00100000:2.0:1788572146.728121:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495294080 00000100:00100000:2.0:1788572146.728200:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788572146.728212:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+20:11546:x1875453495294080:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788572146.728474:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+21:11546:x1875453495294080:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 263us (1792us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788572146.728483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1788572146.731737:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572146.731999:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495294336 00000100:00100000:3.0:1788572146.732011:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495294336 00000100:00100000:3.0:1788572146.732080:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 180 00000100:00100000:3.0:1788572146.732092:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+21:11546:x1875453495294336:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788572146.738111:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+21:11546:x1875453495294336:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 6006us (6369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572146.738138:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 180 00000100:00100000:1.0:1788572146.747938:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572146.751025:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495294464 00000100:00100000:3.0:1788572146.751039:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495294464 00000100:00100000:3.0:1788572146.751103:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 181 00000100:00100000:3.0:1788572146.751114:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+21:11546:x1875453495294464:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572146.751135:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572146.751156:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c001ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11100 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.751658:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c001f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.751677:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c001f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.751689:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c001f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572146.751727:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572146.751747:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c001f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.751775:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c001ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11100 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.751792:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c001f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11100 expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.751801:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:3.0:1788572146.751807:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788572146.751838:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387200, rc 0) 00000100:00100000:3.0:1788572146.752015:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+22:11546:x1875453495294464:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 902us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572146.752022:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 181 00000100:00100000:1.0:1788572146.759981:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572146.761509:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495294592 00000100:00100000:0.0:1788572146.761522:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495294592 00000100:00100000:0.0:1788572146.761645:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:0.0:1788572146.761655:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495294592:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572146.761673:0:11678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572146.761692:0:11678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11107 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572146.761716:0:11678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b71f2, blocks: 0x1 00010000:00010000:0.0:1788572146.761741:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1788572146.761745:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.761756:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11107 expref: 8 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.761774:0:11678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11107 expref: 8 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.761787:0:11678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ac00, rc 0) 00000100:00100000:0.0:1788572146.761838:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495294592:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 185us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572146.761845:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1788572146.769355:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572146.769554:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495294848 00000100:00100000:0.0:1788572146.769564:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495294848 00000100:00100000:0.0:1788572146.769634:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 182 00000100:00100000:0.0:1788572146.769647:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+22:11546:x1875453495294848:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788572146.769791:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+22:11546:x1875453495294848:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 147us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572146.769802:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 182 00000040:00080000:1.0:1788572146.773032:0:12453:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572146.773042:0:12453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572146.773078:0:12453:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788572146.773084:0:12453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788572146.787857:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572146.787932:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495294976 00000100:00100000:2.0:1788572146.787943:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495294976 00000100:00100000:2.0:1788572146.787997:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:2.0:1788572146.788007:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:11546:x1875453495294976:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572146.788024:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572146.788049:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1110e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.788120:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11107 expref: 9 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.788131:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.788135:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572146.788140:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.788196:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11107 expref: 9 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572146.788212:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11107 expref: 9 pid: 11678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572146.788225:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518362112:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572146.788338:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059bbd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572146.817005:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572146.817404:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495295104 00000100:00100000:0.0:1788572146.817417:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495295104 00010000:00010000:0.0:1788572146.817461:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11107 expref: 10 pid: 11678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572146.817510:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:0.0:1788572146.817520:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+10:2355:x1875453495295104:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572146.817547:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572146.817571:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11107 expref: 10 pid: 11678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.817586:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11107 expref: 10 pid: 11678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.817612:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.817618:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572146.817627:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.817637:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572146.817674:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572146.817688:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c050632680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1875453518362240:192.168.202.2@tcp:105: 00000100:00100000:0.0:1788572146.817772:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c048538cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788572146.819079:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc86468e/0x977d9e7969c001fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11107 expref: 10 pid: 11678 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572146.819099:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518362112:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572146.819124:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572146.819136:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d200, rc 0) 00000100:00100000:3.0:1788572146.819196:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+9:11546:x1875453495294976:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 31180us (31338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572146.819204:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:0.0:1788572146.822195:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c050632680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5817:1875453518362240:192.168.202.2@tcp:105: 00010000:00010000:0.0:1788572146.822642:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572146.822721:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495295104:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 5200us (5724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572146.822732:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:0.0:1788572146.835734:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572146.837299:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495295232 00000100:00100000:1.0:1788572146.837327:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495295232 00002000:00100000:1.0:1788572146.837381:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88c050632680 x1875453495295232/t0(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:562/0 lens 504/0 e 0 to 0 dl 1788572157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572146.837393:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c050632680 with x1875453495295232 ext(0->8) 00002000:00010000:1.0:1788572146.837399:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c050632680 00000100:00100000:1.0:1788572146.837433:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788572146.837443:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495295232:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788572146.837900:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78708c10-ef63-4de2-8b1c-aff484c98227+10:2355:x1875453495295232:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 457us (2175us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788572146.837909:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00002000:00100000:1.0:1788572146.837916:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88c050632680 x1875453495295232/t4294967314(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:562/0 lens 504/448 e 0 to 0 dl 1788572157 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572146.837924:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c050632680 with x1875453495295232 ext(0->8) 00002000:00010000:1.0:1788572146.837928:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c050632680 00000100:00100000:1.0:1788572146.850514:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572146.850554:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495295360 00000100:00100000:2.0:1788572146.850563:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495295360 00000100:00100000:2.0:1788572146.850630:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 183 00000100:00100000:2.0:1788572146.850640:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+22:11546:x1875453495295360:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788572146.916017:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+22:11546:x1875453495295360:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 65367us (65501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572146.916030:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 183 00000020:00080000:2.0:1788572146.916837:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788572146.916855:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:2.0:1788572146.916862:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1788572146.916870:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:2.0:1788572146.916992:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572146.917010:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518362368:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1788572146.917632:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788572146.917644:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788572146.918221:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572146.918704:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518362368 00000100:00100000:2.0:1788572146.918714:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518362368 00000100:00100000:2.0:1788572146.918770:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788572146.918779:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518362368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788572146.918944:0:11678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788572146.918948:0:11678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788572146 00002000:00010000:2.0:1788572146.918962:0:11678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788572146.918964:0:11678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788572146 -> 1788572146 00002000:00010000:2.0:1788572146.918966:0:11678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788572146.919017:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518362368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 239us (798us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788572146.919025:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788572146.919222:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788572146.919779:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c076799f80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788572146.919788:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518362368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788572146.925650:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572146.925869:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495295488 00000100:00100000:3.0:1788572146.925881:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495295488 00000100:00100000:3.0:1788572146.925938:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:3.0:1788572146.925950:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+10:2356:x1875453495295488:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788572147.046743:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1788572147.046765:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788572147.047011:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495295488:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 121058us (121366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572147.047029:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1788572147.051030:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572147.055141:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495295744 00000100:00100000:2.0:1788572147.055157:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495295744 00000100:00100000:0.0:1788572147.055537:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 184 00000100:00100000:0.0:1788572147.055549:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+18:11546:x1875453495295744:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788572147.055603:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572147.055630:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c001f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11100 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.055650:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572147.055655:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572147.055686:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.055699:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.055710:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572147.055966:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052133e4d reply state 00000000739963f5 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572147.055975:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572147.056576:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+19:11546:x1875453495295744:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1025us (5548us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788572147.056600:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 184 00000100:00100000:1.0:1788572147.060003:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572147.061537:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495295872 00000100:00100000:2.0:1788572147.061549:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495295872 00000100:00100000:2.0:1788572147.061607:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:2.0:1788572147.061618:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495295872:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788572147.061882:0:11678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788572147.061886:0:11678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788572146 -> 1788572145 00002000:00010000:2.0:1788572147.061888:0:11678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788572143 00002000:00010000:2.0:1788572147.061890:0:11678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788572146 -> 1788572145 00002000:00010000:2.0:1788572147.061892:0:11678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788572147.061953:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495295872:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 336us (1958us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788572147.061961:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00010000:00010000:0.0:1788572147.063021:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.063036:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.063555:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.063563:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572147.063568:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.063577:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.063594:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:0.0:1788572147.063597:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572147.063603:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.063610:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b800/0x977d9e7969c00209 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572147.065295:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572147.066828:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495296128 00000100:00100000:2.0:1788572147.066842:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495296128 00000100:00100000:2.0:1788572147.066910:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 185 00000100:00100000:2.0:1788572147.066921:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+18:11546:x1875453495296128:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788572147.066996:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.067032:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.067042:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.067080:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.067094:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f2 expref: 18 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572147.067107:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518362496:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572147.067214:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c058f7cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572147.072902:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572147.073013:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518362496:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572147.073056:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572147.073172:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495296256 00000100:00100000:3.0:1788572147.073191:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495296256 00010000:00010000:3.0:1788572147.073233:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f2 expref: 19 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572147.073450:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:3.0:1788572147.073462:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+19:2355:x1875453495296256:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572147.073481:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572147.073489:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f2 expref: 19 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.073503:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f2 expref: 19 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.073530:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c001d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f2 expref: 19 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.073552:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:3.0:1788572147.073557:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.073568:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.073576:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.073625:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572147.073678:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+18:2355:x1875453495296256:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 219us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572147.073685:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00010000:00010000:2.0:1788572147.073897:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.073905:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.073931:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.073937:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.073948:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.073954:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572147.073958:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.073966:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.073975:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:2.0:1788572147.073978:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788572147.073982:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.073989:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00210 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572147.074029:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495296128:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 7111us (8744us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788572147.074036:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 185 00000100:00100000:0.0:1788572147.083547:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572147.083681:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495296384 00000100:00100000:2.0:1788572147.083691:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495296384 00000100:00100000:2.0:1788572147.083778:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:2.0:1788572147.083788:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04754c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495296384:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788572147.083847:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.083867:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.083890:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572147.083895:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572147.083900:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.083945:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.083959:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 8 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572147.083974:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518362624:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572147.084066:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c058f7cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572147.089106:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518362624:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572147.089137:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572147.089686:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572147.089770:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495296512 00000100:00100000:2.0:1788572147.089778:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495296512 00010000:00010000:2.0:1788572147.089825:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 9 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572147.089866:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:2.0:1788572147.089876:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495296512:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572147.089910:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572147.089941:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 9 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.089955:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 9 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.089976:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcb47717/0x977d9e7969c00202 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1110e expref: 9 pid: 6681 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.089992:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572147.089996:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572147.090002:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.093112:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.093169:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572147.093276:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495296512:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 3372us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572147.093286:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00010000:00010000:1.0:1788572147.093663:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.093674:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.093709:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.093717:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.093726:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.093733:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572147.093737:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.093746:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.093761:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.093781:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c3a3d76/0x977d9e7969c00217 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572147.093852:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04754c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495296384:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 10064us (10315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572147.093860:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1788572147.097372:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572147.097581:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495296768 00000100:00100000:2.0:1788572147.097590:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495296768 00000100:00100000:2.0:1788572147.097646:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 186 00000100:00100000:2.0:1788572147.097656:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+17:11546:x1875453495296768:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788572147.097753:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.097771:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.097784:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.098222:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.098236:0:10431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f9 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.098275:0:10431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.098374:0:10431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f9 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.098392:0:10431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f9 expref: 18 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572147.098474:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518362752:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572147.098564:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c058f7cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572147.101725:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518362752:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572147.101758:0:10431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572147.106075:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572147.106138:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495296896 00000100:00100000:3.0:1788572147.106149:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495296896 00010000:00010000:3.0:1788572147.106204:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f9 expref: 19 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572147.106326:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:3.0:1788572147.106338:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+19:2355:x1875453495296896:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572147.106352:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572147.106359:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f9 expref: 19 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.106373:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f9 expref: 19 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.106394:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c001e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110f9 expref: 19 pid: 5831 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.106410:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:3.0:1788572147.106417:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.106426:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.106588:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.106614:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572147.106672:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+18:2355:x1875453495296896:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 336us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572147.106680:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 71 00010000:00010000:1.0:1788572147.107030:0:10431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.107040:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788572147.107243:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788572147.107505:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788572147.107551:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788572147.108192:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518362880:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788572147.108530:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572147.108570:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572147.108661:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518362880 00000100:00100000:2.0:1788572147.108669:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518362880 00000100:00100000:2.0:1788572147.108723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788572147.108732:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10431:x1875453518362880:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572147.108896:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10431:x1875453518362880:12345-0@lo:1000:mdt00_003.0 Request processed in 165us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572147.108903:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788572147.108979:0:10431:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788572147.108984:0:10431:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c076799f80, transno 4294967315 00000100:00100000:1.0:1788572147.109002:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518362880:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788572147.110769:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788572147.110988:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518363008:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788572147.111117:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572147.111573:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572147.111648:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518363008 00000100:00100000:0.0:1788572147.111656:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518363008 00000100:00100000:0.0:1788572147.111745:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788572147.111755:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10431:x1875453518363008:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572147.112008:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10431:x1875453518363008:12345-0@lo:1000:mdt00_003.0 Request processed in 254us (890us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788572147.112016:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788572147.112097:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518363008:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788572147.112132:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112143:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112151:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112157:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572147.112162:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112169:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112218:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfd00) 00010000:00010000:1.0:1788572147.112230:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572147.112235:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112241:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00225 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112310:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112324:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112330:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112336:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572147.112339:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112345:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112354:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c058eac400) 00010000:00010000:1.0:1788572147.112356:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788572147.112360:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112365:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0015a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112386:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112400:0:10431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110dd expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112409:0:10431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112437:0:10431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110dd expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572147.112470:0:10431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110dd expref: 21 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572147.112484:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518363136:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572147.112556:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788572147.117620:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572147.117759:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495297024 00000100:00100000:3.0:1788572147.117769:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495297024 00010000:00010000:3.0:1788572147.117811:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110dd expref: 22 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572147.117847:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:3.0:1788572147.117857:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+22:2356:x1875453495297024:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572147.117872:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572147.117880:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110dd expref: 22 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.117894:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110dd expref: 22 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.117917:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c058eac400) 00010000:00010000:3.0:1788572147.117922:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.117931:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.117957:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.117978:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572147.118051:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+22:2356:x1875453495297024:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 194us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572147.118059:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00010000:00010000:2.0:1788572147.118890:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00176 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb110dd expref: 21 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572147.118911:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518363136:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572147.118932:0:10431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.118942:0:10431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.118947:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.118958:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.118964:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.118971:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.118976:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572147.118981:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.118989:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.119014:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c058eac400) 00010000:00010000:2.0:1788572147.119016:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572147.119021:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.119026:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c0022c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.119036:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.119054:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.119061:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.119066:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572147.119069:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.119075:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.119083:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c058eac400) 00010000:00010000:2.0:1788572147.119085:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788572147.119089:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572147.119094:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0021e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572147.119401:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+20:11546:x1875453495296768:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 21745us (22038us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788572147.119422:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 186 00000020:00080000:2.0:1788572147.119427:0:10431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788572147.120352:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572147.120359:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572147.121159:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788572147.121170:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788572147.125069:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572147.125742:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495297280 00000100:00100000:0.0:1788572147.125752:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495297280 00000100:00100000:0.0:1788572147.125868:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:0.0:1788572147.125880:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050314850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+20:11546:x1875453495297280:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788572147.126980:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788572147.127087:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788572147.127142:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.127160:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.127171:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.127192:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.127198:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.127205:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572147.127234:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572147.127414:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572147.127423:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.127431:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572147.127435:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.127443:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.127464:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88c0481bfc00) 00010000:00010000:3.0:1788572147.127468:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572147.127472:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.127478:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00233 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572147.127501:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572147.127504:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572147.127505:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572147.127981:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050314850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+22:11546:x1875453495297280:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 2096us (2915us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788572147.128003:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000020:00080000:0.0:1788572147.128010:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788572147.432562:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788572148.415936:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1788572148.416030:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1788572148.416039:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:3.0:1788572148.457067:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572148.679836:0:12505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572148.679845:0:12505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572148.679882:0:12505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788572148.679887:0:12505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788572148.863539:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572148.863950:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495297536 00000100:00100000:2.0:1788572148.863961:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495297536 00000100:00100000:2.0:1788572148.864055:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 187 00000100:00100000:2.0:1788572148.864067:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+22:11564:x1875453495297536:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572148.864097:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572148.864122:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0023a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11115 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.864294:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00241 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.864310:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00241 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.864323:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00241 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572148.864334:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788572148.864465:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c0023a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11115 expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.864503:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00241 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11115 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.864511:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572148.864514:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572148.864519:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c000, rc 0) 00000100:00100000:2.0:1788572148.864582:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+24:11564:x1875453495297536:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 516us (1052us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788572148.864589:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 187 00000100:00080000:3.0:1788572148.865196:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572148.877337:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572148.877423:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495297664 00000100:00100000:2.0:1788572148.877434:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495297664 00000100:00100000:2.0:1788572148.877498:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 188 00000100:00100000:2.0:1788572148.877511:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+24:11564:x1875453495297664:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:2.0:1788572148.877616:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.877635:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.877649:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.877666:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.877673:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.877703:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.877961:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.877967:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.877973:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572148.878016:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878030:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878036:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878042:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878047:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572148.878051:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878058:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878069:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572148.878079:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572148.878084:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878090:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c0024f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878104:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878109:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878114:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878118:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572148.878121:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878137:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878146:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef600) 00010000:00010000:2.0:1788572148.878149:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572148.878152:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878157:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878170:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878182:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878188:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878193:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572148.878196:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878201:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878209:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0593efc00) 00010000:00010000:2.0:1788572148.878211:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572148.878215:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.878221:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c0025d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572148.878323:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+24:11564:x1875453495297664:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 813us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572148.878332:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 188 00000100:00100000:3.0:1788572148.954827:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572148.955203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495297920 00000100:00100000:0.0:1788572148.955214:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495297920 00000100:00100000:0.0:1788572148.955306:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 189 00000100:00100000:0.0:1788572148.955317:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+24:11567:x1875453495297920:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572148.955341:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572148.955364:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00264 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1111c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955443:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955458:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955472:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955487:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955494:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955500:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955778:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955794:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955801:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572148.955812:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788572148.955902:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955911:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955918:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955924:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572148.955929:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955937:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955950:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:0.0:1788572148.955953:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572148.955958:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.955964:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c0026b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956327:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956342:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956347:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956353:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ba00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572148.956356:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956363:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956372:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0481bf100) 00010000:00010000:0.0:1788572148.956375:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572148.956377:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956383:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00272 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956428:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00264 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1111c expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956442:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1111c expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572148.956449:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:0.0:1788572148.956452:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572148.956460:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ae00, rc 0) 00000100:00100000:0.0:1788572148.956574:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+26:11567:x1875453495297920:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1259us (1756us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788572148.956582:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 189 00000100:00100000:3.0:1788572148.964574:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572148.966569:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495298048 00000100:00100000:2.0:1788572148.966585:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495298048 00000100:00100000:2.0:1788572148.966658:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 190 00000100:00100000:2.0:1788572148.966668:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+26:11567:x1875453495298048:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:2.0:1788572148.967220:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.967301:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.968068:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.968102:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.968110:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.968117:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.968194:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572148.968199:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.968208:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.968222:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:2.0:1788572148.968226:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572148.968230:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572148.968237:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d000/0x977d9e7969c00287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572148.969058:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+26:11567:x1875453495298048:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 1685us (3788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572148.969085:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 190 00000100:00100000:3.0:1788572148.978855:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572148.980033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495298304 00000100:00100000:2.0:1788572148.980047:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495298304 00000100:00100000:2.0:1788572148.980112:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:2.0:1788572148.980122:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+26:11567:x1875453495298304:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572148.980395:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+27:11567:x1875453495298304:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 274us (1551us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788572148.980404:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:3.0:1788572149.040108:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572149.042358:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495298560 00000100:00100000:0.0:1788572149.042378:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495298560 00000100:00100000:0.0:1788572149.042462:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 191 00000100:00100000:0.0:1788572149.042474:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+27:11093:x1875453495298560:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572149.042501:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572149.042526:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c0028e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11123 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.042624:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.042636:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1111c expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.042643:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.042675:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1111c expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.042689:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1111c expref: 28 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572149.042702:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c35d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518363264:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572149.042798:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059ecb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572149.047295:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572149.047361:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495298688 00000100:00100000:3.0:1788572149.047373:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495298688 00010000:00010000:3.0:1788572149.047416:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1111c expref: 29 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572149.047476:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:1.0:1788572149.047490:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+29:2355:x1875453495298688:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572149.047505:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572149.047513:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1111c expref: 29 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.047526:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1111c expref: 29 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.047551:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:1.0:1788572149.047574:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.047584:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.047592:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.047612:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572149.047674:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+29:2355:x1875453495298688:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 188us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572149.047681:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00010000:00010000:0.0:1788572149.048543:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ae00/0x977d9e7969c00279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1111c expref: 28 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572149.048571:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c35d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5830:1875453518363264:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572149.048594:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.048604:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.048610:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572149.048629:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788572149.048791:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c0028e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11123 expref: 29 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.048807:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11123 expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.048815:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:0.0:1788572149.048818:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788572149.048821:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ba00, rc 0) 00000100:00100000:0.0:1788572149.048866:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+28:11093:x1875453495298560:12345-192.168.202.2@tcp:101:bash.0 Request processed in 6394us (8765us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788572149.048874:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 191 00000100:00100000:2.0:1788572149.052952:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572149.053085:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495298944 00000100:00100000:0.0:1788572149.053094:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495298944 00000100:00100000:0.0:1788572149.053156:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:0.0:1788572149.053181:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+28:11093:x1875453495298944:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:0.0:1788572149.053500:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.053517:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.053528:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572149.053581:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788572149.053607:0:10431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041951d13 reply state 00000000a0459084 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572149.053617:0:10431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788572149.053668:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788572149.053779:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+32:11093:x1875453495298944:12345-192.168.202.2@tcp:36:bash.0 Request processed in 598us (836us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788572149.053785:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 192 00000020:00080000:0.0:1788572149.053790:0:10431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788572149.057542:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.057560:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.057567:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.057574:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.057579:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.057587:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.057606:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:2.0:1788572149.057609:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.057630:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.057637:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b000/0x977d9e7969c002a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572149.058909:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572149.058998:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495299072 00000100:00100000:0.0:1788572149.059008:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495299072 00000100:00100000:0.0:1788572149.059068:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 193 00000100:00100000:0.0:1788572149.059078:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+31:11093:x1875453495299072:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572149.059102:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572149.059119:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c002aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1112a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.059190:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c002aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1112a expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.059217:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c002aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1112a expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.059282:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:0.0:1788572149.059286:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572149.059290:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b400, rc 0) 00000100:00100000:0.0:1788572149.059338:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+32:11093:x1875453495299072:12345-192.168.202.2@tcp:101:bash.0 Request processed in 263us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572149.059343:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 193 00000100:00100000:3.0:1788572149.062413:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.062473:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495299200 00000100:00100000:2.0:1788572149.062483:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495299200 00000100:00100000:2.0:1788572149.062554:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:2.0:1788572149.062566:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:11093:x1875453495299200:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572149.062583:0:11678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572149.062604:0:11678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11131 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788572149.062629:0:11678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b71f1, atime: 0x6a9b71ef, ctime: 0x6a9b71f1, blocks: 0xb 00010000:00010000:2.0:1788572149.062651:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1788572149.062656:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572149.062666:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11131 expref: 8 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.062693:0:11678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11131 expref: 8 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.062705:0:11678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d000, rc 0) 00000100:00100000:2.0:1788572149.062760:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+8:11093:x1875453495299200:12345-192.168.202.2@tcp:101:bash.0 Request processed in 197us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572149.062767:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00080000:3.0:1788572149.063278:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572149.069376:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572149.069523:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495299328 00000100:00100000:3.0:1788572149.069534:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495299328 00002000:00010000:3.0:1788572149.069579:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788572149.069584:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07fd10a80 with x1875453495299328 ext(0->18446744073709551615) 00002000:00010000:3.0:1788572149.069597:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c07fd10a80. 00000100:00100000:3.0:1788572149.069628:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788572149.069639:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495299328:12345-192.168.202.2@tcp:10:bash.0 00002000:00010000:3.0:1788572149.069904:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788572149.069907:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788572145 -> 1788572149 00002000:00010000:3.0:1788572149.069909:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788572143 -> 1788572143 00002000:00010000:3.0:1788572149.069910:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788572145 -> 1788572149 00002000:00010000:3.0:1788572149.069912:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788572149.069967:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495299328:12345-192.168.202.2@tcp:10:bash.0 Request processed in 331us (612us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788572149.069978:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00002000:00010000:3.0:1788572149.069993:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788572149.069995:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07fd10a80 with x1875453495299328 ext(0->18446744073709551615) 00002000:00010000:3.0:1788572149.069998:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c07fd10a80. 00000040:00080000:1.0:1788572149.160637:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572149.160647:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572149.160690:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788572149.160697:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788572149.234509:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.234785:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495299456 00000100:00100000:2.0:1788572149.234795:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495299456 00000100:00100000:2.0:1788572149.234864:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:2.0:1788572149.234875:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+32:11582:x1875453495299456:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:2.0:1788572149.234951:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.234978:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.234993:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235009:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235016:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235022:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235326:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235336:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235344:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572149.235384:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235405:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235411:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235418:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235423:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.235427:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235434:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235446:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572149.235449:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.235454:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235461:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235484:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235490:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235495:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235508:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.235511:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235517:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235526:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef500) 00010000:00010000:2.0:1788572149.235529:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.235532:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235538:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235552:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235557:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235562:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235566:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0da00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.235568:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235573:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235590:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:2.0:1788572149.235592:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.235596:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.235614:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572149.236721:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+32:11582:x1875453495299456:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 1839us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572149.236732:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:0.0:1788572149.318888:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.319017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495299712 00000100:00100000:2.0:1788572149.319027:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495299712 00000100:00100000:2.0:1788572149.319089:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 195 00000100:00100000:2.0:1788572149.319101:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+32:11585:x1875453495299712:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572149.319143:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572149.319171:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11138 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.319291:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.319305:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.319314:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.319328:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.319359:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.319365:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.319671:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c002e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.319681:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c002e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.319883:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c002e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572149.319903:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788572149.320024:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320033:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320040:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320047:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.320052:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320061:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320086:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572149.320089:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.320094:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320101:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320124:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320135:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320141:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320147:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.320150:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320155:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320162:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef500) 00010000:00010000:2.0:1788572149.320164:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.320167:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320172:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c002db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320757:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c002cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11138 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320859:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c002e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11138 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.320868:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:2.0:1788572149.320870:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788572149.320873:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d200, rc 0) 00000100:00100000:2.0:1788572149.321024:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+34:11585:x1875453495299712:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1923us (2145us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788572149.321034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 195 00000100:00100000:3.0:1788572149.326232:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.326606:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495299840 00000100:00100000:2.0:1788572149.326617:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495299840 00000100:00100000:2.0:1788572149.326678:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:2.0:1788572149.326689:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+34:11585:x1875453495299840:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:2.0:1788572149.326756:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.326773:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11123 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.326782:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.326817:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11123 expref: 34 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.326847:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11123 expref: 34 pid: 5830 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572149.326863:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502af100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518363392:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572149.326953:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059eea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572149.330133:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.330282:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502af100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518363392:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572149.330310:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572149.330569:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495300096 00000100:00100000:3.0:1788572149.330576:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495300096 00000100:00100000:3.0:1788572149.330632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1788572149.330642:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+35:10580:x1875453495300096:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788572149.330972:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+36:10580:x1875453495300096:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 329us (859us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788572149.330980:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1788572149.335080:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.335503:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495300224 00000100:00100000:2.0:1788572149.335514:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495300224 00010000:00010000:2.0:1788572149.335557:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11123 expref: 36 pid: 5830 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572149.335600:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:2.0:1788572149.335611:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+36:2355:x1875453495300224:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572149.335630:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572149.335637:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11123 expref: 36 pid: 5830 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.335650:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11123 expref: 36 pid: 5830 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.335674:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00295 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11123 expref: 36 pid: 5830 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.335721:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:2.0:1788572149.335728:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.335737:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.335745:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.335777:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572149.335848:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+35:2355:x1875453495300224:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 238us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572149.335855:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00010000:00010000:3.0:1788572149.337052:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.337064:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.337096:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.337102:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.337109:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.337124:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572149.337128:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.337165:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.337180:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:3.0:1788572149.337183:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572149.337188:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.337195:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c002f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572149.337316:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+34:11585:x1875453495299840:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 10626us (11092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572149.337326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:3.0:1788572149.341077:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.341170:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495300480 00000100:00100000:2.0:1788572149.341179:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495300480 00000100:00100000:2.0:1788572149.341229:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:2.0:1788572149.341237:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+34:11585:x1875453495300480:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572149.341514:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+35:11585:x1875453495300480:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 275us (444us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788572149.341522:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:0.0:1788572149.452206:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572149.452402:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495300736 00000100:00100000:3.0:1788572149.452413:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495300736 00000100:00100000:3.0:1788572149.452610:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 197 00000100:00100000:3.0:1788572149.452621:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+35:11596:x1875453495300736:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:3.0:1788572149.452647:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572149.452669:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c002f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1113f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.452745:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.452761:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.452791:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.452809:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.452816:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.452824:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453730:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0030c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453747:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0030c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453757:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0030c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572149.453769:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788572149.453896:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453905:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453913:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453920:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572149.453937:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453947:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453960:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572149.453963:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572149.453968:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453976:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c002fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453992:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.453998:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.454004:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.454010:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572149.454013:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.454020:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.454027:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c059bcd000) 00010000:00010000:3.0:1788572149.454029:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572149.454040:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.454047:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00305 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.454101:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c002f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1113f expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.454146:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0030c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1113f expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.454153:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:3.0:1788572149.454156:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572149.454159:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030000, rc 0) 00000100:00100000:3.0:1788572149.454235:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+37:11596:x1875453495300736:12345-192.168.202.2@tcp:101:cat.0 Request processed in 1616us (2039us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788572149.454243:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 197 00000100:00100000:1.0:1788572149.462852:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.463216:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495300992 00000100:00100000:2.0:1788572149.463225:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495300992 00000100:00100000:2.0:1788572149.463294:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:2.0:1788572149.463311:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+37:11596:x1875453495300992:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:2.0:1788572149.463703:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+38:11596:x1875453495300992:12345-192.168.202.2@tcp:35:cat.0 Request processed in 392us (858us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788572149.463722:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00010000:00010000:3.0:1788572149.486765:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572149.489180:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.489277:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495301248 00000100:00100000:2.0:1788572149.489287:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495301248 00000100:00100000:2.0:1788572149.489348:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:2.0:1788572149.489358:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+38:11597:x1875453495301248:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:2.0:1788572149.489411:0:10431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788572149.489436:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0030c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1113f expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489468:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c002e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11138 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489483:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c002aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1112a expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489500:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:2.0:1788572149.489511:0:10431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572149.489533:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489546:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489556:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489568:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489592:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489599:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489827:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489837:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.489844:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572149.490370:0:10431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788572149.490379:0:10431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370281129741ns, next at 371281127779ns, rc = 0 00010000:00010000:2.0:1788572149.490432:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490441:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490449:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490457:0:10431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490464:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490482:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490494:0:10431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572149.490514:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490519:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490525:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490531:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.490536:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490543:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490555:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:2.0:1788572149.490558:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572149.490561:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490566:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00328 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490583:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490588:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490600:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490604:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0da00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.490606:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490612:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490618:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572149.490620:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.490623:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.490629:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0031a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572149.490639:0:10431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c4d1203 reply state 00000000ba81f58b transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572149.490646:0:10431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572149.490732:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+37:11597:x1875453495301248:12345-192.168.202.2@tcp:36:rm.0 Request processed in 1373us (1559us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788572149.490740:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 198 00010000:00010000:0.0:1788572149.491673:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572149.491684:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.491692:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572149.491696:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.491704:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.491716:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88c0593eff00) 00010000:00010000:0.0:1788572149.491719:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788572149.491724:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.491747:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0032f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.491766:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572149.491767:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572149.491769:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572149.493916:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.493936:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.493960:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.493965:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.493969:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.493976:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.493991:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef500) 00010000:00010000:2.0:1788572149.493993:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.493998:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.494004:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00321 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572149.587329:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.588510:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495301504 00000100:00100000:2.0:1788572149.588536:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495301504 00000100:00100000:2.0:1788572149.588638:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 199 00000100:00100000:2.0:1788572149.588649:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+36:11603:x1875453495301504:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572149.588690:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572149.588736:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00336 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11146 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.588861:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.588931:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.588944:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.588976:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.588983:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.588990:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572149.590614:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788572149.590961:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.590975:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.590987:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.591027:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.591035:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.591040:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.591056:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0da00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572149.591060:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.591068:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.591081:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572149.591084:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.591089:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.591096:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0033d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572149.591123:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d44e8ad2 reply state 0000000017e282ef transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572149.591142:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572149.591179:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00336 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11146 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.591194:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11146 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.591202:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:2.0:1788572149.591204:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572149.591207:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d200, rc 0) 00000100:00100000:2.0:1788572149.591340:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+39:11603:x1875453495301504:12345-192.168.202.2@tcp:101:bash.0 Request processed in 2693us (4020us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788572149.591355:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 199 00000100:00100000:1.0:1788572149.602711:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572149.603343:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495301632 00000100:00100000:3.0:1788572149.603355:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495301632 00010000:00010000:2.0:1788572149.603437:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.603450:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572149.603454:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00010000:00010000:2.0:1788572149.603463:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.603470:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00000100:00100000:3.0:1788572149.603476:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495301632:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572149.603478:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.603492:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.603508:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef500) 00010000:00010000:2.0:1788572149.603511:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572149.603515:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.603521:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00344 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.603909:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572149.603930:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1114d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572149.603960:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572149.603983:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1788572149.604001:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572149.604011:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1114d expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.604036:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1114d expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.604051:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040031e00, rc 0) 00000100:00080000:1.0:1788572149.604292:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572149.604806:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495301632:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1332us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572149.604817:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1788572149.628212:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.630896:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495301760 00000100:00100000:2.0:1788572149.630917:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495301760 00000100:00100000:2.0:1788572149.631010:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:2.0:1788572149.631021:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+6:11603:x1875453495301760:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572149.631045:0:11678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572149.631102:0:11678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11154 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.631160:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1114d expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.631169:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572149.631174:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572149.631179:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 7 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.631222:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1114d expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.631235:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1114d expref: 7 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572149.631270:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11678:1875453518363520:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572149.631619:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059eea840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572149.638694:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11678:1875453518363520:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572149.638732:0:11678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 7 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.638754:0:11678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c200, rc 0) 00000100:00100000:2.0:1788572149.639066:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:11603:x1875453495301760:12345-192.168.202.2@tcp:101:bash.0 Request processed in 8044us (10859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572149.639122:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:1.0:1788572149.644712:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572149.644851:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495301888 00000100:00100000:3.0:1788572149.644861:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495301888 00010000:00010000:3.0:1788572149.644912:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1114d expref: 7 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572149.644968:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:3.0:1788572149.644979:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495301888:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572149.644996:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572149.645021:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1114d expref: 7 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.645038:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1114d expref: 7 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.645064:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2d630eb/0x977d9e7969c00359 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1114d expref: 7 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.645097:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572149.645102:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572149.645124:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.645134:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.645186:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572149.645202:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4768c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5815:1875453518363648:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788572149.645353:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788572149.649162:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4768c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5815:1875453518363648:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788572149.649195:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572149.649296:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78708c10-ef63-4de2-8b1c-aff484c98227+6:2356:x1875453495301888:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 4318us (4593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572149.649307:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:0.0:1788572149.654379:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.654737:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495302144 00000100:00100000:2.0:1788572149.654747:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495302144 00000100:00100000:2.0:1788572149.654805:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:2.0:1788572149.654814:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+38:11603:x1875453495302144:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:2.0:1788572149.655770:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+39:11603:x1875453495302144:12345-192.168.202.2@tcp:35:bash.0 Request processed in 951us (1395us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788572149.655781:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1788572149.865031:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518363776:0@lo:400:kworker.0 00000100:00100000:1.0:1788572149.865129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572149.865344:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518363904:0@lo:400:kworker.0 00000100:00100000:0.0:1788572149.865390:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572149.865472:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518363904 00000100:00100000:0.0:1788572149.865480:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518363904 00000100:00100000:0.0:1788572149.865529:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788572149.865539:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518363904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572149.865592:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518363904:12345-0@lo:400:kworker.0 Request processed in 54us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572149.865600:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788572149.865645:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518363904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572149.869376:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518363776 00000100:00100000:3.0:1788572149.869393:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518363776 00000100:00100000:3.0:1788572149.869464:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788572149.869474:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518363776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572149.873831:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572149.873852:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518364032:0@lo:400:kworker.0 00000100:00100000:2.0:1788572149.873921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572149.873984:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518364160:0@lo:400:kworker.0 00000100:00100000:2.0:1788572149.874012:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572149.874041:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518364160 00000100:00100000:2.0:1788572149.874048:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518364160 00000100:00100000:2.0:1788572149.874115:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788572149.874125:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518364160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572149.876378:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518364160:12345-0@lo:400:kworker.0 Request processed in 2245us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572149.876391:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1788572149.876434:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572149.876487:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518364160:0@lo:400:kworker.0 00000100:00100000:2.0:1788572149.876555:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572149.876572:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518364288:0@lo:400:kworker.0 00000100:00100000:2.0:1788572149.876612:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572149.876963:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518364416:0@lo:400:kworker.0 00000100:00100000:2.0:1788572149.876988:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572149.877027:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518364032 00000100:00100000:2.0:1788572149.877033:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518364032 00000100:00080000:2.0:1788572149.877051:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572149.877082:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518364288 00000100:00100000:2.0:1788572149.877085:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518364288 00000100:00100000:2.0:1788572149.877120:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788572149.877127:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518364032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572149.877406:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518364416 00000100:00100000:0.0:1788572149.877410:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518364416 00000100:00100000:0.0:1788572149.877439:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788572149.877456:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518364416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572149.877500:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518364416:12345-0@lo:400:kworker.0 Request processed in 45us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572149.877506:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788572149.877554:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1788572149.877560:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1788572149.877577:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c04a09e680, transno 4294967307 00000100:00100000:0.0:1788572149.877590:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518364416:0@lo:400:kworker.0 00000100:00100000:0.0:1788572149.877612:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788572149.877618:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518364288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572149.877665:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518364288:12345-0@lo:400:kworker.0 Request processed in 47us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572149.877672:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788572149.877696:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518364288:0@lo:400:kworker.0 00000100:00080000:0.0:1788572149.877726:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572149.877729:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572149.878535:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518364032:12345-0@lo:400:kworker.0 Request processed in 1403us (4608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572149.878545:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788572149.879017:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3297:x1875453518363776:12345-0@lo:400:kworker.0 Request processed in 9541us (13884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572149.879044:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788572149.879184:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518364032:0@lo:400:kworker.0 00000100:00100000:1.0:1788572149.879912:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3297:1875453518363776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572149.891703:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.892086:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495302272 00000100:00100000:2.0:1788572149.892096:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495302272 00000100:00100000:2.0:1788572149.893955:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:2.0:1788572149.893970:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+39:11619:x1875453495302272:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572149.893995:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572149.894018:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1115b expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.894088:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0036e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.894114:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0036e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.894128:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0036e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572149.894173:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788572149.894193:0:10431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572149.894216:0:10431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0036e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.894241:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1115b expref: 41 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.894282:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0036e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1115b expref: 40 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.894302:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572149.894305:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572149.894308:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0da00, rc 0) 00000100:00100000:2.0:1788572149.894388:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+40:11619:x1875453495302272:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 420us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572149.898513:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572149.898935:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495302528 00000100:00100000:1.0:1788572149.898945:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495302528 00000100:00100000:2.0:1788572149.901899:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:1.0:1788572149.905033:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 201 00000100:00100000:1.0:1788572149.905071:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+40:11619:x1875453495302528:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572149.905096:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572149.905131:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00375 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11162 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.905243:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0037c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.905274:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0037c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.905286:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0037c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572149.905298:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788572149.905605:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00375 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11162 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.905625:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0037c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11162 expref: 42 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.905634:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:1.0:1788572149.905637:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572149.905641:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994200, rc 0) 00000100:00100000:1.0:1788572149.905712:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+42:11619:x1875453495302528:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 650us (7210us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788572149.905793:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 201 00000100:00100000:3.0:1788572149.922117:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572149.922167:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572149.922199:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495302784 00000100:00100000:0.0:1788572149.922210:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495302784 00000100:00100000:0.0:1788572149.922313:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:0.0:1788572149.922324:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+42:11619:x1875453495302784:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572149.922359:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572149.922382:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c0038a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11169 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.922483:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00391 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.922498:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.922523:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00391 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572149.922537:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788572149.922670:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ac00/0x977d9e7969c0038a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11169 expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.922700:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11169 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.922710:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:0.0:1788572149.922713:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:2.0:1788572149.923011:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495302912 00000100:00100000:2.0:1788572149.923017:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495302912 00000100:00100000:2.0:1788572149.923064:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1788572149.923073:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+45:2355:x1875453495302912:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572149.923085:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572149.923113:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c0037c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11162 expref: 45 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.923125:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:2.0:1788572149.923129:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572149.923193:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+44:2355:x1875453495302912:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 121us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572149.923210:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00010000:00010000:0.0:1788572149.923287:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024aa00, rc 0) 00000100:00100000:0.0:1788572149.923318:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+43:11619:x1875453495302784:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 994us (1219us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788572149.923325:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:0.0:1788572149.932893:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.935372:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495303040 00000100:00100000:2.0:1788572149.935389:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495303040 00000100:00100000:2.0:1788572149.935468:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1788572149.935480:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+6:2353:x1875453495303040:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:2.0:1788572149.935527:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.935549:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.935558:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572149.935563:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572149.935567:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.935660:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 6 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.935675:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 6 pid: 11678 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572149.935688:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1875453518364544:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572149.935791:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059eea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572149.940554:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.940569:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1875453518364544:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572149.940608:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572149.941039:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495303168 00000100:00100000:0.0:1788572149.941050:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495303168 00002000:00100000:0.0:1788572149.941122:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88bf4768d180 x1875453495303168/t0(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:565/0 lens 504/0 e 0 to 0 dl 1788572160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788572149.941133:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bf4768d180 with x1875453495303168 ext(0->8) 00010000:00010000:0.0:1788572149.941143:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 7 pid: 11678 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.941161:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 7 pid: 11678 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572149.941184:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88bf4768d180 00000100:00100000:0.0:1788572149.941586:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1788572149.941606:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495303168:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:0.0:1788572149.942709:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495303168:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 1101us (2156us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788572149.942722:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00002000:00100000:0.0:1788572149.942734:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88bf4768d180 x1875453495303168/t4294967308(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:565/0 lens 504/448 e 0 to 0 dl 1788572160 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788572149.942745:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88bf4768d180 with x1875453495303168 ext(0->8) 00010000:00010000:0.0:1788572149.942757:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 9 pid: 11678 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.942779:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 9 pid: 11678 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572149.942787:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88bf4768d180 00000100:00100000:3.0:1788572149.954063:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572149.954276:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495303296 00000100:00100000:2.0:1788572149.954289:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495303296 00010000:00010000:2.0:1788572149.954351:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 9 pid: 11678 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572149.954398:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:2.0:1788572149.954408:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495303296:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572149.954424:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788572149.954443:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788572149.954446:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788572149 00002000:00010000:2.0:1788572149.954448:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788572149 00002000:00010000:2.0:1788572149.954450:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788572149 00010000:00010000:2.0:1788572149.954456:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 9 pid: 11678 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.954470:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 9 pid: 11678 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.954491:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9a11e3/0x977d9e7969c00360 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11154 expref: 9 pid: 11678 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.954508:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572149.954513:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572149.954535:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.954545:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572149.954572:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572149.954634:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+8:2356:x1875453495303296:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 226us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572149.954644:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00010000:00010000:0.0:1788572149.955461:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.955474:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.955504:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.955521:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.955529:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.955537:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572149.955541:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.955551:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.955564:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.955571:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0039f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572149.955632:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2353:x1875453495303040:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 20153us (22747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572149.955641:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:0.0:1788572149.959603:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572149.959674:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495303552 00000100:00100000:3.0:1788572149.959688:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495303552 00000100:00100000:3.0:1788572149.959789:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:3.0:1788572149.959805:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050315450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+43:11619:x1875453495303552:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:3.0:1788572149.959875:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00391 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11169 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572149.960211:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788572149.960355:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788572149.960751:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788572149.960821:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.960843:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11146 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.960853:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.960889:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11146 expref: 47 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572149.960904:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11146 expref: 47 pid: 5831 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572149.960940:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4768dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1875453518364672:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572149.961061:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572149.966881:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572149.966959:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4768dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5833:1875453518364672:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572149.967005:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572149.967090:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495303680 00000100:00100000:1.0:1788572149.967107:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495303680 00010000:00010000:1.0:1788572149.967161:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11146 expref: 48 pid: 5831 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572149.967202:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:1.0:1788572149.967212:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+48:2355:x1875453495303680:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572149.967225:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572149.967231:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11146 expref: 48 pid: 5831 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.967243:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11146 expref: 48 pid: 5831 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.967293:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c0034b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11146 expref: 48 pid: 5831 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.967309:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:1.0:1788572149.967314:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.967323:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.967329:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572149.967350:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572149.967419:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+47:2355:x1875453495303680:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 207us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572149.967427:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00010000:00010000:0.0:1788572149.967544:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.967552:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572149.967686:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788572149.967917:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788572149.968021:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518364800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788572149.968067:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572149.968110:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059ecb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572149.968172:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518364800 00000100:00100000:2.0:1788572149.968178:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518364800 00000100:00100000:2.0:1788572149.968230:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572149.968242:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875453518364800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788572149.968428:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875453518364800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 188us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572149.968457:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572149.969024:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518364800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788572149.969711:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788572149.971028:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518364928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788572149.971109:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572149.971322:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059ecb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572149.977970:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518364928 00000100:00100000:1.0:1788572149.977993:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518364928 00000100:00100000:1.0:1788572149.978060:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788572149.978071:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1875453518364928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788572149.981657:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1875453518364928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 3577us (10547us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788572149.981672:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572149.990437:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5833:1875453518364928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788572149.990552:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788572149.990624:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.990636:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.990644:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.990671:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040030600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572149.990676:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.990685:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.990703:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:0.0:1788572149.990706:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788572149.990712:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572149.991989:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c003a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572149.993300:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788572149.993419:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788572149.993430:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370784181224ns, next at 371784178717ns, rc = 0 00000001:00080000:0.0:1788572149.993439:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788572149.993490:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593efe00) 00010000:00010000:0.0:1788572149.993494:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788572149.993504:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00391 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11169 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572149.993626:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050315450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+50:11619:x1875453495303552:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 33826us (34031us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788572149.993636:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000020:00080000:0.0:1788572149.993642:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788572150.007592:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572150.007708:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495303808 00000100:00100000:2.0:1788572150.007730:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495303808 00000100:00100000:2.0:1788572150.007869:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 203 00000100:00100000:2.0:1788572150.007881:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+50:11619:x1875453495303808:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572150.007906:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572150.007931:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c003ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11170 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.007993:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c003ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11170 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.008026:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c003ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11170 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.008046:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572150.008049:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572150.008053:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c800, rc 0) 00000100:00100000:2.0:1788572150.008163:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+51:11619:x1875453495303808:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 284us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572150.008170:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 203 00000100:00080000:0.0:1788572150.012298:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572150.019803:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572150.019956:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495304064 00000100:00100000:2.0:1788572150.019966:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495304064 00000100:00100000:2.0:1788572150.020023:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:2.0:1788572150.020033:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+51:11619:x1875453495304064:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572150.020331:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+52:11619:x1875453495304064:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 297us (538us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788572150.020338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:3.0:1788572150.124478:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572150.124670:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495304192 00000100:00100000:0.0:1788572150.124681:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495304192 00000100:00100000:0.0:1788572150.124743:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 302 00000100:00100000:0.0:1788572150.124752:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495304192:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572150.124834:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495304192:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 82us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572150.124842:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 302 00000100:00100000:3.0:1788572150.149066:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572150.149348:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495304448 00000100:00100000:2.0:1788572150.149361:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495304448 00000100:00100000:2.0:1788572150.149465:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:2.0:1788572150.149482:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495304448:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572150.149587:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2354:x1875453495304448:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 112us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572150.149596:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00080000:0.0:1788572150.150342:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572150.151443:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572150.151682:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495304320 00000100:00100000:0.0:1788572150.151701:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495304320 00000100:00100000:0.0:1788572150.151759:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:0.0:1788572150.151768:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:2353:x1875453495304320:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572150.151842:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+9:2353:x1875453495304320:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 74us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572150.151850:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:3.0:1788572150.175703:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572150.175859:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495304576 00000100:00100000:2.0:1788572150.175891:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495304576 00000100:00100000:2.0:1788572150.175977:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:2.0:1788572150.175992:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+52:11629:x1875453495304576:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:2.0:1788572150.176088:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176117:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176129:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176153:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176161:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176168:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176312:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176330:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176338:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572150.176383:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176409:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176416:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176423:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176428:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572150.176432:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176439:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176452:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572150.176455:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572150.176467:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.176474:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178792:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178814:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178823:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178850:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ca00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572150.178855:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178863:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178880:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef800) 00010000:00010000:2.0:1788572150.178883:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572150.178887:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178894:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178919:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178926:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178931:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178936:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572150.178939:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178945:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178962:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572150.178964:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572150.178967:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.178972:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572150.179081:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+52:11629:x1875453495304576:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 3089us (3588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572150.179099:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:3.0:1788572150.245619:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572150.245829:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495304832 00000100:00100000:2.0:1788572150.245840:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495304832 00000100:00100000:2.0:1788572150.245904:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 205 00000100:00100000:2.0:1788572150.245915:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+52:11632:x1875453495304832:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572150.245934:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572150.245957:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11177 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246036:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246051:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246065:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246085:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246558:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246566:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246693:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c003de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246702:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c003de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246709:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c003de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572150.246718:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788572150.246820:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246828:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246836:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246841:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ca00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572150.246845:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246853:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246875:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572150.246878:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572150.246883:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246889:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ca00/0x977d9e7969c003d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246901:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246907:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246913:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246918:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572150.246921:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246926:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246932:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c0593ef800) 00010000:00010000:2.0:1788572150.246934:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572150.246936:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246942:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c003d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246986:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c003c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11177 expref: 55 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.246999:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c003de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11177 expref: 54 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.247006:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572150.247008:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572150.247010:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d600, rc 0) 00000100:00100000:2.0:1788572150.247072:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+54:11632:x1875453495304832:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1159us (1464us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788572150.247079:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 205 00000100:00100000:3.0:1788572150.252068:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572150.252292:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495304960 00000100:00100000:1.0:1788572150.252303:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495304960 00000100:00100000:1.0:1788572150.252364:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:1.0:1788572150.252373:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+54:11632:x1875453495304960:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:1.0:1788572150.252441:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.252458:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.252469:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.252664:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.252672:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.252678:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.252683:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572150.252698:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.252707:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.252719:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:1.0:1788572150.252722:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572150.252727:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.252733:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572150.252830:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+54:11632:x1875453495304960:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 455us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572150.252839:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:3.0:1788572150.256616:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572150.256778:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495305216 00000100:00100000:0.0:1788572150.256788:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495305216 00000100:00100000:0.0:1788572150.256848:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:0.0:1788572150.256858:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+54:11632:x1875453495305216:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788572150.257108:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+55:11632:x1875453495305216:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 250us (501us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788572150.257116:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:2.0:1788572150.377280:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518365056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572150.377370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572150.377583:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518365056 00000100:00100000:3.0:1788572150.377593:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518365056 00000100:00100000:3.0:1788572150.377659:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788572150.377670:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518365056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572150.377693:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572150.383007:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518365056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5328us (5626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572150.383025:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788572150.393465:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572150.394239:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518365056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572150.394751:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495305472 00000100:00100000:1.0:1788572150.394760:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495305472 00000100:00100000:1.0:1788572150.394872:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 207 00000100:00100000:1.0:1788572150.394883:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+55:11642:x1875453495305472:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788572150.394906:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572150.394909:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788572150.394944:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0da00/0x977d9e7969c0036e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1115b expref: 55 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.394965:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:1.0:1788572150.394970:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572150.394984:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1117e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.395118:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c003fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.395143:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c003fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.395154:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c003fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572150.395166:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788572150.395349:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c003f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1117e expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.395364:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c003fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1117e expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.395371:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:1.0:1788572150.395374:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572150.395377:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994400, rc 0) 00000100:00100000:1.0:1788572150.395451:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+56:11642:x1875453495305472:12345-192.168.202.2@tcp:101:bash.0 Request processed in 570us (1998us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788572150.395459:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 207 00000100:00100000:0.0:1788572150.400940:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572150.401701:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495305728 00000100:00100000:2.0:1788572150.401711:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495305728 00000100:00100000:2.0:1788572150.401788:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:2.0:1788572150.401798:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+56:11642:x1875453495305728:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:2.0:1788572150.401861:0:10431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788572150.401886:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994400/0x977d9e7969c003fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1117e expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.401907:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c003de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11177 expref: 55 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.402079:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572150.402093:0:10431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572150.402411:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572150.402445:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572150.402456:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572150.402763:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788572150.402788:0:10431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bc94e5a reply state 00000000ec472251 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572150.402798:0:10431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572150.402900:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+57:11642:x1875453495305728:12345-192.168.202.2@tcp:36:bash.0 Request processed in 1102us (1968us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788572150.402908:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 208 00000020:00080000:0.0:1788572150.402914:0:10431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572150.408078:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.408105:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.408111:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.408118:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024bc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572150.408123:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.408142:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.408159:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572150.408162:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572150.408166:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.408173:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024bc00/0x977d9e7969c00408 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572150.417492:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572150.418022:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495305856 00000100:00100000:1.0:1788572150.418031:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495305856 00000100:00100000:1.0:1788572150.418095:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:1.0:1788572150.418104:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+56:11642:x1875453495305856:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788572150.418134:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572150.418169:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c0040f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11185 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.418440:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.418455:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.418467:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572150.418504:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788572150.418508:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572150.418526:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.418551:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c0040f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11185 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.418630:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11185 expref: 57 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.418640:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:1.0:1788572150.418644:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572150.418647:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995e00, rc 0) 00000100:00100000:1.0:1788572150.418699:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+57:11642:x1875453495305856:12345-192.168.202.2@tcp:101:bash.0 Request processed in 596us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572150.418706:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:0.0:1788572150.423989:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572150.424237:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495306112 00000100:00100000:3.0:1788572150.424320:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495306112 00000100:00100000:3.0:1788572150.424380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:3.0:1788572150.424392:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+57:11642:x1875453495306112:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:3.0:1788572150.424793:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+58:11642:x1875453495306112:12345-192.168.202.2@tcp:35:bash.0 Request processed in 402us (812us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788572150.424816:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00010000:00010000:3.0:1788572150.504728:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572150.532996:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572150.533351:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495306240 00000100:00100000:1.0:1788572150.533378:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495306240 00000100:00100000:1.0:1788572150.533441:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:1.0:1788572150.533452:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+58:11648:x1875453495306240:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572150.533489:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572150.533510:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c0041d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1118c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.533577:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.533592:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.533605:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572150.533639:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788572150.533643:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572150.533661:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.533687:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c0041d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1118c expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.533705:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1118c expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.533714:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:1.0:1788572150.533717:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572150.533720:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995200, rc 0) 00000100:00100000:1.0:1788572150.533910:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+59:11648:x1875453495306240:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 458us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572150.534090:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:0.0:1788572150.555565:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572150.555715:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495306368 00000100:00100000:1.0:1788572150.555726:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495306368 00000100:00100000:1.0:1788572150.555788:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:1.0:1788572150.555808:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+59:11648:x1875453495306368:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572150.555829:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572150.555853:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c0042b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11193 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556022:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556038:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556051:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556071:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556077:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556095:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556195:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556223:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556230:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572150.556535:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788572150.556541:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572150.556564:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556578:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556587:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556593:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556599:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556605:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572150.556610:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556617:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556629:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:1.0:1788572150.556632:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572150.556645:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556651:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00432 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556663:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556668:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556673:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556678:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572150.556681:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556687:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556694:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c058eac900) 00010000:00010000:1.0:1788572150.556696:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572150.556698:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556703:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c00439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556734:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c0042b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11193 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556760:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11193 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.556766:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:1.0:1788572150.556768:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572150.556771:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994000, rc 0) 00000100:00100000:1.0:1788572150.557074:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+60:11648:x1875453495306368:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1274us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572150.557093:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:0.0:1788572150.571299:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572150.571447:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495306496 00000100:00100000:2.0:1788572150.571460:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495306496 00000100:00100000:2.0:1788572150.571550:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788572150.571580:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+60:2356:x1875453495306496:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572150.571596:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572150.571624:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11193 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.571646:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572150.571651:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572150.571713:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+59:2356:x1875453495306496:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 135us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572150.571720:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788572150.580375:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572150.580977:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495306752 00000100:00100000:1.0:1788572150.580991:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495306752 00000100:00100000:1.0:1788572150.581064:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:1.0:1788572150.581075:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+59:11648:x1875453495306752:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572150.581108:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572150.581142:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1119a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.582683:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.582710:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11185 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.582719:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.582767:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11185 expref: 60 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572150.582800:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11185 expref: 60 pid: 5830 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572150.583434:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd13800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518365184:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572150.583826:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04a02c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572150.602396:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572150.603472:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd13800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518365184:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572150.603514:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572150.604150:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495306880 00000100:00100000:0.0:1788572150.604161:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495306880 00010000:00010000:0.0:1788572150.604205:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11185 expref: 61 pid: 5830 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572150.604288:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:0.0:1788572150.604298:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+61:2355:x1875453495306880:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572150.604327:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572150.604335:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11185 expref: 61 pid: 5830 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572150.604369:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11185 expref: 61 pid: 5830 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572150.604394:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995e00/0x977d9e7969c00416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11185 expref: 61 pid: 5830 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572150.604411:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:0.0:1788572150.604417:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572150.604426:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572150.604435:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572150.604461:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572150.604702:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+60:2355:x1875453495306880:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 404us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572150.604711:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00010000:00010000:2.0:1788572150.605150:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.605160:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572150.605180:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788572150.606346:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1119a expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.606376:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1119a expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.606385:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572150.606388:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572150.606391:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994800, rc 0) 00000100:00100000:2.0:1788572150.606462:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+60:11648:x1875453495306752:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 25388us (26097us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788572150.606471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:0.0:1788572150.613876:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572150.614112:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495307136 00000100:00100000:3.0:1788572150.614134:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495307136 00000100:00100000:3.0:1788572150.614206:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:3.0:1788572150.614217:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+60:11648:x1875453495307136:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:3.0:1788572150.614233:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572150.614280:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c003ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11170 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572150.614299:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:3.0:1788572150.614316:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572150.614383:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+59:11648:x1875453495307136:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 168us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572150.614391:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1788572150.631157:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572150.631820:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495307264 00000100:00100000:3.0:1788572150.631831:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495307264 00000100:00100000:3.0:1788572150.631886:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:3.0:1788572150.631897:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+59:11648:x1875453495307264:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:3.0:1788572150.632038:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572150.632059:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572150.632072:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572150.632354:0:10431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788572150.632446:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+59:11648:x1875453495307264:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 550us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572150.632455:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:0.0:1788572150.641812:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572150.642036:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495307392 00000100:00100000:2.0:1788572150.642045:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495307392 00000100:00100000:2.0:1788572150.642167:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:2.0:1788572150.642178:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+59:11648:x1875453495307392:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572150.642313:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572150.642337:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c00463 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111a1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.642398:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.642410:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c00463 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a1 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.642431:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.642445:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c00463 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a1 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.642458:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572150.642461:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572150.642465:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c00463 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a1 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572150.642483:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0de00, rc 0) 00000100:00100000:2.0:1788572150.642555:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+60:11648:x1875453495307392:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 378us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572150.642562:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 214 00000004:00080000:2.0:1788572150.888841:0:7096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371679590024ns, next at 372679587614ns, rc = 0 00000100:00100000:0.0:1788572150.889226:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572150.889274:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518365312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572150.889470:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572150.889901:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518365312 00000100:00100000:2.0:1788572150.889920:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518365312 00000100:00100000:2.0:1788572150.898841:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788572150.898869:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518365312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572150.898923:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572150.899026:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518365312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (9557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572150.899034:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788572150.899154:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518365312:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788572151.208529:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788572151.208539:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788572151.208578:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788572151.208584:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788572151.208709:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0765d0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518365440:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788572151.208825:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059ecb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572151.212172:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.212317:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0765d0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518365440:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788572151.212690:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495307520 00000100:00100000:3.0:1788572151.212698:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495307520 00000100:00100000:3.0:1788572151.212760:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:3.0:1788572151.212770:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+60:11649:x1875453495307520:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788572151.212805:0:10431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788572151.212917:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+60:11649:x1875453495307520:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 147us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572151.212925:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:2.0:1788572151.217354:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.217462:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495307648 00000100:00100000:1.0:1788572151.217474:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495307648 00000100:00100000:1.0:1788572151.217551:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:1.0:1788572151.217563:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+60:11649:x1875453495307648:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788572151.217637:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217654:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217668:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217684:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217692:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217715:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217740:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217748:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217755:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572151.217795:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788572151.217801:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572151.217815:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217827:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217834:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217841:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217847:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572151.217852:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217860:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217882:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:1.0:1788572151.217885:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572151.217891:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217898:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0046a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217913:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217919:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217924:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217929:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572151.217932:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217937:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217945:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff88c058eac900) 00010000:00010000:1.0:1788572151.217947:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572151.217950:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217955:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00471 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217981:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217987:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217992:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.217996:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995c00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572151.217999:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.218004:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.218010:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:1.0:1788572151.218013:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572151.218015:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.218020:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c00478 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572151.218115:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+60:11649:x1875453495307648:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 553us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572151.218123:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:0.0:1788572151.232300:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.232424:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495307904 00000100:00100000:3.0:1788572151.232434:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495307904 00000100:00100000:3.0:1788572151.232494:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:3.0:1788572151.232505:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0765d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+60:11649:x1875453495307904:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572151.232539:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572151.232562:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c0047f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111a8 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232681:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232698:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232710:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572151.232739:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788572151.232860:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232869:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232876:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232882:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040030000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572151.232886:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232894:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232907:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:3.0:1788572151.232910:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788572151.232914:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232921:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c00486 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232963:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c0047f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a8 expref: 62 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232973:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:3.0:1788572151.232975:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572151.232986:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c0047f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a8 expref: 62 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.232995:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030600, rc 0) 00000100:00100000:3.0:1788572151.233056:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0765d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+61:11649:x1875453495307904:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 553us (812us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788572151.233074:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:0.0:1788572151.236944:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.237150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495308032 00000100:00100000:1.0:1788572151.237162:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495308032 00000100:00100000:1.0:1788572151.237222:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:1.0:1788572151.237276:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+61:11649:x1875453495308032:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788572151.237331:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788572151.237448:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+61:11649:x1875453495308032:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 201us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572151.237456:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:2.0:1788572151.242220:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.242546:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495308288 00000100:00100000:3.0:1788572151.242556:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495308288 00000100:00100000:3.0:1788572151.242617:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 219 00000100:00100000:3.0:1788572151.242628:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+61:11649:x1875453495308288:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572151.242651:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572151.242655:0:10431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788572151.242682:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00424 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1118c expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.242701:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572151.242707:0:10431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572151.242720:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c00494 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111af expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572151.243145:0:10431:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788572151.244581:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0049b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.244600:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0049b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.244611:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0049b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.244689:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c00494 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111af expref: 63 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.244708:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0049b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111af expref: 62 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.244717:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c059bcd000) 00010000:00010000:3.0:1788572151.244720:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572151.244722:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030000, rc 0) 00000100:00100000:3.0:1788572151.244789:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+62:11649:x1875453495308288:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2163us (2580us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788572151.244798:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 219 00000100:00100000:0.0:1788572151.248005:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572151.248579:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495308544 00000100:00100000:2.0:1788572151.248590:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495308544 00000100:00100000:2.0:1788572151.248651:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:2.0:1788572151.248662:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+62:11649:x1875453495308544:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788572151.248723:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572151.248750:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c0049b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111af expref: 62 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.248770:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c059bcd000) 00010000:00010000:2.0:1788572151.248780:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572151.248804:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.248817:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.248840:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.248911:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.248919:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.248926:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.248991:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.248999:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249005:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249010:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572151.249014:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249021:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249028:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572151.249031:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572151.249034:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249046:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c600/0x977d9e7969c004a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249055:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249073:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249079:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249083:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572151.249087:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249092:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249100:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf11ebe98 (ffff88c0593ef800) 00010000:00010000:2.0:1788572151.249391:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572151.249397:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.249403:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d600/0x977d9e7969c004b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf11ebe98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.249530:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+61:11649:x1875453495308544:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 868us (1531us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572151.249537:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:0.0:1788572151.257588:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.257743:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495308672 00000100:00100000:1.0:1788572151.257754:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495308672 00000100:00100000:1.0:1788572151.257855:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 221 00000100:00100000:1.0:1788572151.257866:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+61:11649:x1875453495308672:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572151.257886:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572151.257908:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c004b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111b6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.257944:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.257959:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.257970:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.258079:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c004b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111b6 expref: 63 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.258098:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111b6 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.258126:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:1.0:1788572151.258129:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788572151.258133:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995800, rc 0) 00000100:00100000:1.0:1788572151.258192:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+62:11649:x1875453495308672:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 328us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572151.258199:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 221 00000100:00100000:0.0:1788572151.262137:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.262476:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495308928 00000100:00100000:3.0:1788572151.262487:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495308928 00000100:00100000:3.0:1788572151.262552:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 222 00000100:00100000:3.0:1788572151.262563:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+62:11649:x1875453495308928:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788572151.262650:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.262668:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.262681:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572151.262949:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:3.0:1788572151.263042:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4c3ce7f reply state 00000000dc5eb3cd transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572151.263078:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572151.263184:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+64:11649:x1875453495308928:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 622us (1057us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788572151.263191:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 222 00000100:00100000:0.0:1788572151.266327:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.267051:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495309056 00000100:00100000:3.0:1788572151.267072:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495309056 00000100:00100000:3.0:1788572151.267144:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 223 00000100:00100000:3.0:1788572151.267154:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+64:11649:x1875453495309056:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572151.267177:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572151.267197:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111bd expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.267283:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111bd expref: 65 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.267309:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111bd expref: 65 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.267329:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:3.0:1788572151.267332:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572151.267336:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030000, rc 0) 00000100:00100000:3.0:1788572151.267393:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+65:11649:x1875453495309056:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 239us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572151.267400:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 223 00000100:00100000:0.0:1788572151.272535:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.272670:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495309184 00000100:00100000:3.0:1788572151.272681:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495309184 00000100:00100000:3.0:1788572151.272774:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:3.0:1788572151.272786:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495309184:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788572151.273086:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+10:2356:x1875453495309184:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 302us (561us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788572151.273094:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00080000:0.0:1788572151.273210:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572151.274862:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.274879:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.274887:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.274893:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040030600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572151.274898:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.274906:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.274922:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:2.0:1788572151.274925:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788572151.274930:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.274936:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030600/0x977d9e7969c004c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572151.281937:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.282030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495309440 00000100:00100000:3.0:1788572151.282039:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495309440 00000100:00100000:3.0:1788572151.282123:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:3.0:1788572151.282134:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+64:11649:x1875453495309440:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788572151.282542:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+65:11649:x1875453495309440:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 409us (617us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788572151.282550:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:0.0:1788572151.291645:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572151.291729:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495309696 00000100:00100000:2.0:1788572151.291739:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495309696 00000100:00100000:2.0:1788572151.291794:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 224 00000100:00100000:2.0:1788572151.291803:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+65:11649:x1875453495309696:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788572151.291906:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+65:11649:x1875453495309696:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 104us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.291914:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 224 00000100:00100000:0.0:1788572151.295503:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.295634:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495309824 00000100:00100000:1.0:1788572151.295645:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495309824 00000100:00100000:1.0:1788572151.295701:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 225 00000100:00100000:1.0:1788572151.295710:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+65:11649:x1875453495309824:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572151.295731:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572151.295751:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c004d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111c4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.295823:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c004da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.295839:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c004da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.295850:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c004da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572151.295886:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572151.295904:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c004da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.295929:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995c00/0x977d9e7969c004d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111c4 expref: 67 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.295960:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c004da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111c4 expref: 66 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.295969:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:1.0:1788572151.295972:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788572151.295976:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994600, rc 0) 00000100:00100000:1.0:1788572151.296050:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+66:11649:x1875453495309824:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 340us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572151.296068:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 225 00000100:00100000:0.0:1788572151.308905:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.308989:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495309952 00000100:00100000:1.0:1788572151.308999:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495309952 00000100:00100000:1.0:1788572151.309053:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:1.0:1788572151.309073:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+10:2355:x1875453495309952:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788572151.309092:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572151.309126:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111cb expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572151.309157:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b71f7, blocks: 0x1 00010000:00010000:1.0:1788572151.309179:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1788572151.309184:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572151.309194:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111cb expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.309213:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111cb expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.309271:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995c00, rc 0) 00000100:00100000:1.0:1788572151.309343:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+11:2355:x1875453495309952:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 271us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572151.309351:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:2.0:1788572151.313797:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.313973:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495310208 00000100:00100000:1.0:1788572151.313983:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495310208 00000100:00100000:1.0:1788572151.314042:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 226 00000100:00100000:1.0:1788572151.314053:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+66:11649:x1875453495310208:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788572151.314185:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+66:11649:x1875453495310208:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 134us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572151.314194:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 226 00000100:00100000:0.0:1788572151.318299:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.318421:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495310336 00000100:00100000:3.0:1788572151.318432:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495310336 00000100:00100000:3.0:1788572151.318481:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:3.0:1788572151.318491:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+11:11649:x1875453495310336:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572151.318510:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572151.318542:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111d2 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.318574:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111cb expref: 12 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.318583:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572151.318587:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572151.318609:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.318645:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111cb expref: 12 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.318659:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111cb expref: 12 pid: 6679 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572151.318673:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07bfb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1875453518365568:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572151.318770:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572151.325320:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.325602:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07bfb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1875453518365568:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572151.325639:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.325661:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c040030600, rc 0) 00000100:00100000:3.0:1788572151.325728:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+12:11649:x1875453495310336:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 7237us (7491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572151.325737:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:2.0:1788572151.327100:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495310464 00000100:00100000:2.0:1788572151.327115:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495310464 00010000:00010000:2.0:1788572151.327163:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111cb expref: 12 pid: 6679 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.327211:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:2.0:1788572151.327220:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+12:2355:x1875453495310464:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572151.327236:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572151.327301:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111cb expref: 12 pid: 6679 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.327315:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111cb expref: 12 pid: 6679 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.327340:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be071dba/0x977d9e7969c004e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111cb expref: 12 pid: 6679 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.327357:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572151.327362:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572151.327371:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.327382:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.327441:0:11167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.327471:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11167:1875453518365696:192.168.202.2@tcp:105: 00000100:00100000:2.0:1788572151.327572:0:11167:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059eea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572151.347330:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.347368:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495310592 00000100:00100000:1.0:1788572151.347383:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495310592 00002000:00100000:1.0:1788572151.347440:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff88c05076b800 x1875453495310592/t0(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:567/0 lens 504/0 e 0 to 0 dl 1788572162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572151.347451:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c05076b800 with x1875453495310592 ext(0->12) 00002000:00010000:1.0:1788572151.347458:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c05076b800 00000100:00100000:1.0:1788572151.347497:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788572151.347508:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78708c10-ef63-4de2-8b1c-aff484c98227+12:2356:x1875453495310592:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788572151.348071:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78708c10-ef63-4de2-8b1c-aff484c98227+14:2356:x1875453495310592:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 553us (741us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788572151.348080:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00002000:00100000:1.0:1788572151.348089:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff88c05076b800 x1875453495310592/t4294967320(0) o4->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:567/0 lens 504/448 e 0 to 0 dl 1788572162 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572151.348104:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c05076b800 with x1875453495310592 ext(0->12) 00002000:00010000:1.0:1788572151.348108:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c05076b800 00000100:00100000:2.0:1788572151.349366:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11167:1875453518365696:192.168.202.2@tcp:105: 00010000:00010000:2.0:1788572151.349391:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572151.349446:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+13:2355:x1875453495310464:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 22226us (24137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.349456:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:0.0:1788572151.354967:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.355108:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495310720 00000100:00100000:1.0:1788572151.355120:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495310720 00000100:00100000:1.0:1788572151.355182:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 227 00000100:00100000:1.0:1788572151.355192:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+66:11649:x1875453495310720:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788572151.406179:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+66:11649:x1875453495310720:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 50905us (51138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572151.406193:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 227 00000001:00080000:3.0:1788572151.406296:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000004:00080000:3.0:1788572151.406317:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788572151.406342:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c0537f7e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788572151.406346:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c0592e4c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c0537f7840 00000020:00080000:3.0:1788572151.406349:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c0592e4500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c076e64000 00000020:00080000:3.0:1788572151.406386:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c0591b1540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788572151.406404:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c052f98e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c0557f0480 00000020:00080000:3.0:1788572151.406407:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c052f98800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c076c7cc00 00000004:00080000:3.0:1788572151.406420:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:3.0:1788572151.406435:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000100:00100000:1.0:1788572151.406723:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518365824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572151.406791:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572151.406850:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518365824 00000100:00100000:1.0:1788572151.406856:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518365824 00000100:00100000:1.0:1788572151.406907:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788572151.406916:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518365824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572151.406943:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1788572151.406975:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b71f5, atime: 0x6a9b71f5, ctime: 0x6a9b71f5, blocks: 0x1 00010000:00010000:1.0:1788572151.406982:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.406999:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1788572151.407004:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572151.407010:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.407039:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.407049:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.407069:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.407088:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572151.407995:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3297:x1875453518365824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1076us (1200us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788572151.408005:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1788572151.408037:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572151.408044:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.408065:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572151.408070:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.408080:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.408096:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572151.408202:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1788572151.408241:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00010000:00010000:1.0:1788572151.408427:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be071dba/0x977d9e7969c004ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.408449:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572151.408523:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572151.408526:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572151.408566:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c07fd13800/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788572151.408573:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518365824:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788572151.408753:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788572151.411218:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:0.0:1788572151.411270:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572151.412043:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572151.412077:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518365952:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572151.412162:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572151.412402:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518365952 00000100:00100000:2.0:1788572151.412410:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518365952 00000100:00100000:2.0:1788572151.412541:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788572151.412552:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1875453518365952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572151.412586:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788572151.412613:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.412636:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11131 expref: 12 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.412644:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788572151.412649:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572151.412653:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.412695:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11131 expref: 12 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.412709:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11131 expref: 12 pid: 11678 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.412721:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518366080:192.168.202.2@tcp:104: 00000100:00080000:3.0:1788572151.412879:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572151.413587:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c048538e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572151.413663:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572151.413759:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495310848 00000100:00100000:2.0:1788572151.413767:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495310848 00000100:00100000:2.0:1788572151.413811:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:2.0:1788572151.413820:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+13:2356:x1875453495310848:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788572151.427155:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572151.427220:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518366080:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572151.427269:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572151.427441:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495310976 00000100:00100000:0.0:1788572151.427448:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495310976 00010000:00010000:0.0:1788572151.427617:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11131 expref: 14 pid: 11678 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572151.427652:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:0.0:1788572151.427661:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+14:2356:x1875453495310976:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572151.427676:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572151.427682:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11131 expref: 14 pid: 11678 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.427695:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11131 expref: 14 pid: 11678 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.427719:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fe376db/0x977d9e7969c002b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11131 expref: 14 pid: 11678 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.427736:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788572151.427741:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788572151.427747:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.427771:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.427935:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572151.427986:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+13:2356:x1875453495310976:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 325us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572151.427995:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00010000:00010000:0.0:1788572151.428025:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.428035:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.428047:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.428068:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.428085:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572151.433743:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3297:x1875453518365952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21183us (21570us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788572151.433757:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1788572151.433874:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572151.433883:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.433903:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572151.433908:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.433920:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.433940:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.433948:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dca3a974/0x977d9e7969c004f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.433969:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572151.433971:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572151.433972:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572151.442350:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c0502aca80/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788572151.442377:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518365952:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788572151.470626:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1788572151.470645:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1788572151.470886:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2356:x1875453495310848:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 57059us (57215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572151.470898:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1788572151.475144:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.475445:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495311232 00000100:00100000:1.0:1788572151.475467:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495311232 00000100:00100000:1.0:1788572151.475532:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 228 00000100:00100000:1.0:1788572151.475543:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+20:11649:x1875453495311232:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788572151.475599:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572151.475627:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c004da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111c4 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.475646:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:1.0:1788572151.475651:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572151.475682:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.475696:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.475706:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572151.476355:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c09bece reply state 00000000aecdf6de transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572151.476367:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572151.476543:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+21:11649:x1875453495311232:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 999us (1416us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788572151.476551:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 228 00010000:00010000:1.0:1788572151.480990:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.481006:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.481013:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.481018:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572151.481023:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.481030:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.481047:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:1.0:1788572151.481050:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572151.481065:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.481072:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c004fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.481162:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.481520:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495311360 00000100:00100000:3.0:1788572151.481530:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495311360 00000100:00100000:2.0:1788572151.481689:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1788572151.481699:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+7:2354:x1875453495311360:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788572151.482069:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788572151.482074:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788572150 00002000:00010000:2.0:1788572151.482077:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788572149 00002000:00010000:2.0:1788572151.482079:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788572151 -> 1788572150 00002000:00010000:2.0:1788572151.482081:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788572151.482272:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+8:2354:x1875453495311360:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 549us (1345us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788572151.482286:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:0.0:1788572151.485963:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.486159:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495311616 00000100:00100000:3.0:1788572151.486169:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495311616 00000100:00100000:3.0:1788572151.486228:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 229 00000100:00100000:3.0:1788572151.486240:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+20:11649:x1875453495311616:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788572151.486354:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.486373:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111b6 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.486383:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.486421:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111b6 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.486463:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111b6 expref: 20 pid: 5830 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572151.486479:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07bfb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518366208:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572151.486559:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572151.490585:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07bfb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5832:1875453518366208:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572151.490615:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572151.493680:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.494141:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495311744 00000100:00100000:1.0:1788572151.494151:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495311744 00010000:00010000:1.0:1788572151.494198:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111b6 expref: 21 pid: 5830 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572151.494244:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:1.0:1788572151.494275:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+21:2356:x1875453495311744:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572151.494300:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572151.494308:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111b6 expref: 21 pid: 5830 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.494322:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111b6 expref: 21 pid: 5830 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.494344:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c004be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111b6 expref: 21 pid: 5830 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.494358:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:1.0:1788572151.494364:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.494374:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.494380:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.494522:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572151.494590:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+20:2356:x1875453495311744:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 316us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572151.494598:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00010000:00010000:3.0:1788572151.496538:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.496555:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.496668:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.496678:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.496702:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.496708:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572151.496712:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.496720:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.496738:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:0.0:1788572151.496742:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788572151.496747:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.496754:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041386800/0x977d9e7969c00504 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572151.497038:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+19:11649:x1875453495311616:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 10794us (11078us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788572151.497049:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 229 00000100:00100000:0.0:1788572151.501992:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572151.502075:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495311872 00000100:00100000:2.0:1788572151.502086:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495311872 00000100:00100000:2.0:1788572151.502145:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:2.0:1788572151.502154:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:2355:x1875453495311872:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788572151.502195:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.502214:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.502223:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572151.502227:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788572151.502232:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.502600:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.502617:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 8 pid: 6680 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.502636:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518366336:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572151.502731:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572151.507043:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.507289:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495312000 00000100:00100000:3.0:1788572151.507299:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495312000 00010000:00010000:3.0:1788572151.507341:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 9 pid: 6680 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572151.507378:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:3.0:1788572151.507389:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495312000:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572151.507404:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572151.507430:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 9 pid: 6680 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.507481:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 9 pid: 6680 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.507510:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572151.507514:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788572151.507521:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.507530:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.507552:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572151.507612:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+9:2356:x1875453495312000:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 225us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572151.507619:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00010000:00010000:0.0:1788572151.509600:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e661cae5/0x977d9e7969c004e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d2 expref: 8 pid: 6680 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572151.509628:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1875453518366336:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572151.509655:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.509687:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.509695:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.509731:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.509741:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.509751:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.509758:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572151.509762:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.509844:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.509867:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.509888:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9a11e3/0x977d9e7969c0050b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572151.510124:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495311872:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 7968us (8139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572151.510143:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:2.0:1788572151.513656:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.513754:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495312256 00000100:00100000:3.0:1788572151.513765:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495312256 00000100:00100000:3.0:1788572151.514011:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 230 00000100:00100000:3.0:1788572151.514022:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+19:11649:x1875453495312256:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788572151.514123:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.514143:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.514155:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.514439:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.514629:0:10431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111bd expref: 20 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572151.514639:0:10431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.514756:0:10431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111bd expref: 20 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.514795:0:10431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111bd expref: 20 pid: 10431 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.514812:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518366464:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572151.514917:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485380c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572151.519170:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572151.519313:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518366464:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572151.519343:0:10431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.519650:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495312384 00000100:00100000:2.0:1788572151.519658:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495312384 00010000:00010000:2.0:1788572151.519696:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111bd expref: 21 pid: 10431 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.519740:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:2.0:1788572151.519750:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+21:2356:x1875453495312384:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572151.519765:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572151.519772:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111bd expref: 21 pid: 10431 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.519786:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111bd expref: 21 pid: 10431 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.519810:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040030000/0x977d9e7969c004cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111bd expref: 21 pid: 10431 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.519826:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:2.0:1788572151.519831:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.519853:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.519861:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.519884:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572151.520572:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78708c10-ef63-4de2-8b1c-aff484c98227+20:2356:x1875453495312384:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 819us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.520581:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00010000:00010000:2.0:1788572151.520611:0:10431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.520619:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572151.520813:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788572151.523680:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788572151.523785:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788572151.523891:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518366592:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572151.524212:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572151.524590:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0591b1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572151.524711:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518366592 00000100:00100000:0.0:1788572151.524721:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518366592 00000100:00100000:0.0:1788572151.524882:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788572151.524893:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10431:x1875453518366592:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788572151.525108:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10431:x1875453518366592:12345-0@lo:1000:mdt00_003.0 Request processed in 217us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572151.525116:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572151.525288:0:10431:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1788572151.525294:0:10431:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1788572151.525322:0:10431:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88c0502aca80 x1875453518365952/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572167 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572151.525336:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518366592:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788572151.526362:0:10431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788572151.526678:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518366720:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788572151.526742:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572151.526887:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c059ecb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788572151.526997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518366720 00000100:00100000:1.0:1788572151.527005:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518366720 00000100:00100000:1.0:1788572151.527071:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788572151.527079:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10431:x1875453518366720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788572151.527668:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10431:x1875453518366720:12345-0@lo:1000:mdt00_003.0 Request processed in 588us (924us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788572151.527677:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788572151.527747:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10431:1875453518366720:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788572151.527862:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.527873:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.527880:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.527886:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572151.527891:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.527899:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.527980:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c058eac900) 00010000:00010000:2.0:1788572151.527983:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572151.527988:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.527994:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387a00/0x977d9e7969c00519 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.528024:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.528030:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.528049:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.528066:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040031e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572151.528069:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.528075:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.528083:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572151.528085:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572151.528093:0:10431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c00463 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a1 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.528172:0:10431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c00463 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a1 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.528181:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c00463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a1 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.528211:0:10431:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c00463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a1 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.528225:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf4768ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518366848:192.168.202.2@tcp:105: 00000100:00100000:2.0:1788572151.528657:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0485380c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788572151.532899:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572151.533341:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf4768ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10431:1875453518366848:192.168.202.2@tcp:105: 00010000:00010000:2.0:1788572151.533389:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533401:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031e00/0x977d9e7969c0045c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533436:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533615:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533630:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533641:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533647:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533653:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533658:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572151.533662:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533668:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533679:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572151.533682:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572151.533693:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533699:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00520 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533711:0:10431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533717:0:10431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533723:0:10431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533728:0:10431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572151.533731:0:10431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533737:0:10431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533744:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572151.533746:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788572151.533749:0:10431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.533753:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387200/0x977d9e7969c00512 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572151.534130:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+23:11649:x1875453495312256:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 20107us (20483us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788572151.534141:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 230 00000020:00080000:2.0:1788572151.534153:0:10431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788572151.535181:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572151.535189:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572151.538227:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788572151.538270:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788572151.542714:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.543215:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495312512 00000100:00100000:3.0:1788572151.543226:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495312512 00000100:00100000:3.0:1788572151.543324:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:3.0:1788572151.543336:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+23:11648:x1875453495312512:12345-192.168.202.2@tcp:49:lfs.0 00000100:00100000:3.0:1788572151.543501:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+23:11648:x1875453495312512:12345-192.168.202.2@tcp:49:lfs.0 Request processed in 167us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572151.543508:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:0.0:1788572151.552328:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572151.552408:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572151.552496:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495312768 00000100:00100000:3.0:1788572151.552506:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495312768 00000100:00100000:3.0:1788572151.552578:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:3.0:1788572151.552588:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050314c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+23:11649:x1875453495312768:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788572151.559106:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788572151.559367:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788572151.559450:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.560195:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.560221:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.560230:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.560236:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.560242:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.560517:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572151.560658:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050314c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+25:11649:x1875453495312768:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 8068us (8532us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788572151.560668:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000020:00080000:0.0:1788572151.560673:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788572151.563409:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495313024 00000100:00100000:2.0:1788572151.563428:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495313024 00000100:00100000:2.0:1788572151.563507:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 231 00000100:00100000:2.0:1788572151.563517:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+25:11648:x1875453495313024:12345-192.168.202.2@tcp:58:lfs.0 00000040:00080000:2.0:1788572151.564069:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788572151.565088:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+25:11648:x1875453495313024:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 1564us (12671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.565115:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 231 00010000:00010000:1.0:1788572151.566014:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572151.566027:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.566038:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ba00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572151.566044:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.566065:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.566088:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88c0481bf100) 00010000:00010000:1.0:1788572151.566102:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788572151.566108:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.566393:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00527 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.566505:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572151.566508:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572151.566510:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572151.627349:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.627493:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495313152 00000100:00100000:1.0:1788572151.627503:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495313152 00000100:00100000:1.0:1788572151.627569:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 232 00000100:00100000:1.0:1788572151.627580:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+25:11651:x1875453495313152:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572151.627603:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572151.627624:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0052e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.627689:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.627703:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.627716:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.627731:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.627738:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.627745:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.628418:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.628438:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1119a expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.628446:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.628481:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1119a expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572151.628495:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1119a expref: 26 pid: 5831 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572151.628511:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518366976:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572151.633512:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04a02cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572151.642076:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572151.642284:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495313408 00000100:00100000:1.0:1788572151.642293:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495313408 00000100:00100000:1.0:1788572151.642350:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:1.0:1788572151.642360:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+27:10581:x1875453495313408:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788572151.642582:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+28:10581:x1875453495313408:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 223us (515us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788572151.642590:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:0.0:1788572151.644342:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5831:1875453518366976:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572151.644377:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572151.648200:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572151.648462:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495313536 00000100:00100000:0.0:1788572151.648474:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495313536 00010000:00010000:0.0:1788572151.648518:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1119a expref: 28 pid: 5831 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572151.648588:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:0.0:1788572151.648600:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+28:2356:x1875453495313536:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572151.648617:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572151.648625:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1119a expref: 28 pid: 5831 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.648638:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1119a expref: 28 pid: 5831 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.648661:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994800/0x977d9e7969c0044e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1119a expref: 28 pid: 5831 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.649020:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:0.0:1788572151.649027:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.649037:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.649045:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572151.649095:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572151.649555:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78708c10-ef63-4de2-8b1c-aff484c98227+27:2356:x1875453495313536:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 955us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572151.649563:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00010000:00010000:2.0:1788572151.649697:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649706:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572151.649751:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788572151.649756:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572151.649788:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649801:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649811:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649818:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649825:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649839:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572151.649844:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649852:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649865:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:2.0:1788572151.649867:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572151.649871:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649877:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00535 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649888:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649894:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649910:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649916:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572151.649918:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649925:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649943:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88c058eac500) 00010000:00010000:2.0:1788572151.649945:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572151.649949:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649954:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c0053c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.649991:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c0052e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d9 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.650005:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d9 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572151.650012:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572151.650014:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572151.650016:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994a00, rc 0) 00000100:00100000:2.0:1788572151.650060:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07676dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+26:11651:x1875453495313152:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 22472us (22713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572151.650068:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 232 00010000:00010000:1.0:1788572152.559534:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788572152.559744:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788572152.559751:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788572152.559811:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788572152.559821:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788572152.559948:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07bfb1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518367104:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788572152.560072:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788572152.564016:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07bfb1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11683:1875453518367104:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572152.565694:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572152.565873:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495313664 00000100:00100000:3.0:1788572152.565882:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495313664 00000100:00100000:3.0:1788572152.565948:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 233 00000100:00100000:3.0:1788572152.565959:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+26:11662:x1875453495313664:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788572152.565993:0:5830:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788572152.566109:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+26:11662:x1875453495313664:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 151us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572152.566117:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 233 00000100:00080000:0.0:1788572152.566168:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572152.579106:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572152.579232:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495313920 00000100:00100000:2.0:1788572152.579243:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495313920 00000100:00100000:2.0:1788572152.579345:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:2.0:1788572152.579356:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+26:11662:x1875453495313920:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572152.579379:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572152.579402:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0054a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111e0 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.579525:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00551 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.579540:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.579553:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572152.579565:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788572152.579701:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0054a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111e0 expref: 29 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.579719:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111e0 expref: 28 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.579730:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572152.579733:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572152.579737:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c400, rc 0) 00000100:00100000:2.0:1788572152.579792:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+28:11662:x1875453495313920:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 437us (696us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788572152.579800:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:1.0:1788572152.591316:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572152.591394:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572152.591579:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495314304 00000100:00100000:0.0:1788572152.591591:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495314304 00000100:00100000:0.0:1788572152.591653:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:0.0:1788572152.591663:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+28:2355:x1875453495314304:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572152.591676:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572152.591698:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00551 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111e0 expref: 28 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572152.591716:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:0.0:1788572152.591721:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572152.591775:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78708c10-ef63-4de2-8b1c-aff484c98227+27:2355:x1875453495314304:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 114us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572152.591783:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1788572152.591851:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495314176 00000100:00100000:2.0:1788572152.591855:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495314176 00000100:00100000:2.0:1788572152.591890:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 235 00000100:00100000:2.0:1788572152.591897:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+27:11662:x1875453495314176:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788572152.591959:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.591979:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.591989:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.592184:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.592192:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.592199:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.592205:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572152.592209:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.592218:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.592226:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572152.592228:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788572152.592232:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572152.592237:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c0055f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572152.592361:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+28:11662:x1875453495314176:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 463us (1055us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788572152.592373:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 235 00000040:00080000:1.0:1788572152.592687:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572152.592691:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572152.593430:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788572152.593441:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788572152.614417:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572152.614478:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495314560 00000100:00100000:3.0:1788572152.614490:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495314560 00000100:00100000:3.0:1788572152.614561:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:3.0:1788572152.614571:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+28:11662:x1875453495314560:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788572152.614825:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+29:11662:x1875453495314560:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 254us (419us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788572152.614833:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000040:00080000:1.0:1788572152.698802:0:12557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788572152.698810:0:12557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572152.698853:0:12557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788572152.698858:0:12557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788572153.012442:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572153.012534:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495314816 00000100:00100000:2.0:1788572153.012545:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495314816 00000100:00100000:2.0:1788572153.012605:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 236 00000100:00100000:2.0:1788572153.012615:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+29:11675:x1875453495314816:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572153.012640:0:10431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572153.012662:0:10431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00566 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111e7 expref: -99 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.012757:0:10431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0056d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.012772:0:10431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0056d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.012782:0:10431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0056d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572153.012793:0:10431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788572153.012913:0:10431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00566 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111e7 expref: 32 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.012930:0:10431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0056d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111e7 expref: 31 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.012938:0:10431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572153.012941:0:10431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788572153.012958:0:10431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ce00, rc 0) 00000100:00100000:2.0:1788572153.013058:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78708c10-ef63-4de2-8b1c-aff484c98227+31:11675:x1875453495314816:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 444us (626us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788572153.013064:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 236 00000100:00100000:1.0:1788572153.016138:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572153.016213:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495314944 00000100:00100000:2.0:1788572153.016223:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495314944 00000100:00100000:2.0:1788572153.016315:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 237 00000100:00100000:2.0:1788572153.016325:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+31:11675:x1875453495314944:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:2.0:1788572153.016396:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.016413:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.016425:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.016450:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.016457:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.016463:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.016469:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572153.016472:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.016479:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.016508:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:2.0:1788572153.016511:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572153.016516:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572153.016523:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c0057b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572153.016598:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78708c10-ef63-4de2-8b1c-aff484c98227+31:11675:x1875453495314944:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 273us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572153.016606:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 237 00000100:00100000:1.0:1788572153.120855:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572153.120987:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495315072 00000100:00100000:3.0:1788572153.120998:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495315072 00000100:00100000:3.0:1788572153.121113:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:3.0:1788572153.121124:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:2354:x1875453495315072:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:3.0:1788572153.121144:0:11678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572153.121165:0:11678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c00582 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111ee expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572153.121211:0:11678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9b71f6, atime: 0x6a9b71f5, ctime: 0x6a9b71f6, blocks: 0xb 00010000:00010000:3.0:1788572153.121232:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1788572153.121237:0:11678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572153.121281:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c00582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111ee expref: 8 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572153.121299:0:11678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c00582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111ee expref: 8 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572153.121313:0:11678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387a00, rc 0) 00000100:00100000:3.0:1788572153.121382:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+8:2354:x1875453495315072:12345-192.168.202.2@tcp:101:cat.0 Request processed in 260us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572153.121390:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00080000:0.0:1788572153.121525:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572153.129518:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572153.129785:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495315200 00000100:00100000:1.0:1788572153.129796:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495315200 00002000:00100000:1.0:1788572153.129855:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff88c07bfb1c00 x1875453495315200/t0(0) o3->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:569/0 lens 488/0 e 0 to 0 dl 1788572164 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572153.129866:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07bfb1c00 with x1875453495315200 ext(0->4095) 00002000:00010000:1.0:1788572153.129871:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c07bfb1c00 00000100:00100000:1.0:1788572153.129905:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572153.129914:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+8:2353:x1875453495315200:12345-192.168.202.2@tcp:3:cat.0 00000100:00100000:1.0:1788572153.130149:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78708c10-ef63-4de2-8b1c-aff484c98227+8:2353:x1875453495315200:12345-192.168.202.2@tcp:3:cat.0 Request processed in 235us (639us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788572153.130158:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00002000:00100000:1.0:1788572153.130165:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff88c07bfb1c00 x1875453495315200/t0(0) o3->78708c10-ef63-4de2-8b1c-aff484c98227@192.168.202.2@tcp:569/0 lens 488/4536 e 0 to 0 dl 1788572164 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788572153.130174:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88c07bfb1c00 with x1875453495315200 ext(0->4095) 00002000:00010000:1.0:1788572153.130177:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88c07bfb1c00 00000001:00080000:2.0:1788572153.549497:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1788572153.549523:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1788572153.576697:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572154.617362:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572154.989777:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518367488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572154.989858:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572154.989975:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518367488 00000100:00100000:1.0:1788572154.989983:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518367488 00000100:00100000:1.0:1788572154.990055:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788572154.990065:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518367488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572154.990116:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518367488:12345-0@lo:400:kworker.0 Request processed in 53us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572154.990123:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1788572154.990145:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572154.990177:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518367488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572154.990230:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518367616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572154.990292:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572154.990323:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518367616 00000100:00100000:1.0:1788572154.990327:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518367616 00000100:00100000:1.0:1788572154.990374:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788572154.990389:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518367616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572154.990425:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518367616:12345-0@lo:400:kworker.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572154.990431:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788572154.990448:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572154.990464:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518367616:0@lo:400:kworker.0 00000100:00100000:2.0:1788572154.990619:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518367360:0@lo:400:kworker.0 00000100:00100000:2.0:1788572154.990652:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572154.990682:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518367872:0@lo:400:kworker.0 00000100:00100000:2.0:1788572154.990705:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572154.990725:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572154.990732:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518367232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572154.990773:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572154.991293:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518367360 00000100:00100000:1.0:1788572154.991300:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518367360 00000100:00100000:1.0:1788572154.991338:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788572154.991345:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518367360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572154.991402:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518367360:12345-0@lo:400:kworker.0 Request processed in 58us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572154.991409:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788572154.994985:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518367872 00000100:00100000:0.0:1788572154.995001:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518367872 00000100:00100000:0.0:1788572154.995086:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788572154.995100:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf4768ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518367872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572154.995199:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf4768ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518367872:12345-0@lo:400:kworker.0 Request processed in 104us (4492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572154.995207:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788572154.997603:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518367744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572154.997671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572154.997783:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518367360:0@lo:400:kworker.0 00000100:00100000:2.0:1788572154.997796:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788572154.997802:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788572154.997825:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c07fd13800, transno 4294967310 00000100:00100000:2.0:1788572154.997856:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518367872:0@lo:400:kworker.0 00000100:00080000:1.0:1788572154.998328:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572154.998497:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518367232 00000100:00100000:3.0:1788572154.998504:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518367232 00000100:00100000:3.0:1788572154.998551:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788572154.998562:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518367232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572154.998627:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518367232:12345-0@lo:400:kworker.0 Request processed in 68us (7853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572154.998635:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788572155.001100:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518367232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572155.003085:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518367744 00000100:00100000:0.0:1788572155.003100:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518367744 00000100:00100000:1.0:1788572155.003276:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788572155.003288:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518367744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572155.003383:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518367744:12345-0@lo:400:kworker.0 Request processed in 98us (5712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572155.003390:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788572155.003433:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c34d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518367744:0@lo:400:kworker.0 00000100:00080000:0.0:1788572155.003602:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572155.227108:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572155.227159:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572155.227299:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495315456 00000100:00100000:2.0:1788572155.227311:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495315456 00000100:00100000:2.0:1788572155.227389:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:2.0:1788572155.227399:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+31:2353:x1875453495315456:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572155.227486:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+31:2353:x1875453495315456:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 88us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572155.227494:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00080000:2.0:1788572155.227518:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572155.227605:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572155.228140:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495315328 00000100:00100000:2.0:1788572155.228148:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495315328 00000100:00100000:2.0:1788572155.228190:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 304 00000100:00100000:2.0:1788572155.228196:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495315328:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572155.228229:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2353:x1875453495315328:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 33us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572155.228235:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 304 00000100:00100000:1.0:1788572155.228396:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572155.228451:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572155.228472:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495315840 00000100:00100000:1.0:1788572155.228476:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495315840 00000100:00100000:1.0:1788572155.228510:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 176 00000100:00100000:1.0:1788572155.228516:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495315840:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572155.228551:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2353:x1875453495315840:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572155.228557:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 176 00000100:00100000:3.0:1788572155.228880:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495315712 00000100:00100000:3.0:1788572155.228899:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495315712 00000100:00100000:2.0:1788572155.229187:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495315584 00000100:00100000:2.0:1788572155.229192:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495315584 00000100:00100000:2.0:1788572155.229225:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:2.0:1788572155.229233:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:2353:x1875453495315584:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572155.229305:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78708c10-ef63-4de2-8b1c-aff484c98227+8:2353:x1875453495315584:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 73us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572155.229313:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00080000:1.0:1788572155.229422:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572155.229426:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572155.229428:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572155.240107:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:2.0:1788572155.240135:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495315712:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572155.240269:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c34fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78708c10-ef63-4de2-8b1c-aff484c98227+5:2353:x1875453495315712:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 118us (13085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572155.240279:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:1.0:1788572155.496706:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518368000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572155.496808:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572155.496996:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518368000 00000100:00100000:3.0:1788572155.497005:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518368000 00000100:00100000:3.0:1788572155.497070:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788572155.497079:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518368000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572155.497114:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572155.504094:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518368000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7006us (7276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572155.504111:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788572155.508144:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518368000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572155.624487:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572156.011307:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518368128:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788572156.011311:0:7096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376802060932ns, next at 377802058173ns, rc = 0 00000100:00100000:2.0:1788572156.011378:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572156.011426:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518368128 00000100:00100000:0.0:1788572156.011435:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518368128 00000100:00100000:0.0:1788572156.011513:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788572156.011524:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518368128:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788572156.011540:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788572156.011559:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572156.011617:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518368128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572156.011624:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788572156.011690:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518368128:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788572156.625530:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1788572156.625548:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788572156.625555:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000004:00080000:0.0:1788572156.626060:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000020:00080000:0.0:1788572156.626086:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1788572156.626104:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000001:00080000:0.0:1788572156.626113:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788572156.626130:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88c0591b1900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788572156.626136:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c0506e0300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88c0591b1480 00000020:00080000:0.0:1788572156.626139:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88c0506e0000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88c07fd0dc00 00000020:00080000:0.0:1788572156.626174:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788572156.626441:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788572156.626596:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572156.626618:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518368256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788572156.627453:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572156.636501:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518368256 00000100:00100000:3.0:1788572156.636518:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518368256 00000100:00100000:0.0:1788572156.638842:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788572156.638857:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518368256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788572156.639462:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788572156.639469:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788572150 -> 1788572150 00002000:00010000:0.0:1788572156.639472:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788572149 -> 1788572149 00002000:00010000:0.0:1788572156.639474:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788572150 -> 1788572150 00002000:00010000:0.0:1788572156.639476:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788572156.639648:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518368256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 793us (12197us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788572156.639658:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788572156.643016:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1788572156.643035:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c0502aca80, transno 4294967321 00000004:00080000:2.0:1788572156.643058:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1788572156.643093:0:3300:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88c07ba40e00 x1875453518368256/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788572172 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788572156.643108:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88c07ba40e00/2, rc 0, transno 4294967324 00000100:00100000:2.0:1788572156.643115:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518368256:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788572156.648551:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572157.672574:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572158.696430:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572159.702379:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572159.702494:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495315968 00000100:00100000:1.0:1788572159.702506:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495315968 00000100:00100000:1.0:1788572159.702582:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00100000:1.0:1788572159.702593:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+18:11328:x1875453495315968:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788572159.702702:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78708c10-ef63-4de2-8b1c-aff484c98227+18:11328:x1875453495315968:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 Request processed in 111us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572159.702709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00080000:2.0:1788572159.703070:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572159.707095:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572159.707384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495316224 00000100:00100000:1.0:1788572159.707394:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495316224 00000100:00100000:1.0:1788572159.707455:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:1.0:1788572159.707476:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+18:11328:x1875453495316224:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788572159.707848:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+19:11328:x1875453495316224:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 381us (761us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788572159.707856:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00010000:00010000:3.0:1788572159.720688:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572159.784516:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788572159.784528:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572159.785929:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788572159.786009:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788572160.104599:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572160.104719:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572160.104742:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518368768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572160.104827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572160.105034:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518368512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572160.105080:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572160.105129:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518368768 00000100:00100000:3.0:1788572160.105136:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518368768 00000100:00100000:1.0:1788572160.105327:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518368384:0@lo:400:kworker.0 00000100:00100000:1.0:1788572160.105378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572160.105405:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518368512 00000100:00100000:1.0:1788572160.105409:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518368512 00000100:00100000:1.0:1788572160.105449:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788572160.105473:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518368512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572160.105531:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518368512:12345-0@lo:400:kworker.0 Request processed in 61us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572160.105538:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:2.0:1788572160.105628:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572160.105670:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518368512:0@lo:400:kworker.0 00000100:00100000:2.0:1788572160.105697:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572160.105721:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c04a09e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518368640:0@lo:400:kworker.0 00000100:00100000:2.0:1788572160.105750:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572160.106427:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788572160.106439:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518368768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572160.106501:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875453518368768:12345-0@lo:400:kworker.0 Request processed in 67us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572160.106507:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788572160.106555:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518368768:0@lo:400:kworker.0 00000100:00100000:3.0:1788572160.106585:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518368640 00000100:00100000:3.0:1788572160.106589:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518368640 00000100:00100000:3.0:1788572160.106625:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788572160.106632:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518368640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572160.106662:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518368640:12345-0@lo:400:kworker.0 Request processed in 32us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572160.106681:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1788572160.106698:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572160.107414:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572160.107429:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518369024:0@lo:400:kworker.0 00000100:00100000:0.0:1788572160.107484:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572160.107556:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07c365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518368896:0@lo:400:kworker.0 00000100:00100000:3.0:1788572160.107587:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572160.107647:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518368384 00000100:00100000:1.0:1788572160.107653:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518368384 00000100:00100000:1.0:1788572160.107687:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788572160.107694:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518368384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572160.108596:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518368384:12345-0@lo:400:kworker.0 Request processed in 899us (3214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572160.108605:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788572160.108645:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518368896 00000100:00100000:1.0:1788572160.108650:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518368896 00000100:00100000:1.0:1788572160.108694:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788572160.108700:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518368896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572160.108746:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518368896:12345-0@lo:400:kworker.0 Request processed in 46us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572160.108752:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788572160.110077:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c04a09e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518368640:0@lo:400:kworker.0 00000100:00100000:2.0:1788572160.110119:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518369024 00000100:00100000:2.0:1788572160.110124:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518369024 00000100:00100000:2.0:1788572160.110167:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788572160.110175:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518369024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572160.110372:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518369024:12345-0@lo:400:kworker.0 Request processed in 197us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572160.110379:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788572160.110567:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572160.110572:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572160.111496:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518368384:0@lo:400:kworker.0 00000100:00100000:0.0:1788572160.112966:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518369024:0@lo:400:kworker.0 00000100:00100000:3.0:1788572160.113134:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07c365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518368896:0@lo:400:kworker.0 00000100:00100000:3.0:1788572160.153842:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572160.154080:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495316352 00000100:00100000:1.0:1788572160.154091:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495316352 00000100:00100000:1.0:1788572160.154178:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 239 00000100:00100000:1.0:1788572160.154189:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:12128:x1875453495316352:12345-192.168.202.2@tcp:101:lsof.0 00010000:00010000:1.0:1788572160.154233:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572160.154346:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb111f5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.154409:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c00590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.154423:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c00590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.154435:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c00590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572160.154658:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788572160.154721:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788572160.154725:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572160.154750:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c00590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.154774:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111f5 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.154792:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c00590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111f5 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572160.154801:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd600) 00010000:00010000:1.0:1788572160.154804:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572160.154818:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994200, rc 0) 00000100:00100000:1.0:1788572160.154897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:12128:x1875453495316352:12345-192.168.202.2@tcp:101:lsof.0 Request processed in 709us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572160.154904:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 239 00000100:00100000:3.0:1788572160.348518:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572160.356547:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495316480 00000100:00100000:2.0:1788572160.356565:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495316480 00000100:00100000:2.0:1788572160.356639:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 306 00000100:00100000:2.0:1788572160.356650:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495316480:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572160.356735:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2356:x1875453495316480:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 86us (8226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572160.356742:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 306 00000100:00100000:3.0:1788572160.379616:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572160.379676:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572160.383677:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495316608 00000100:00100000:0.0:1788572160.383696:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495316608 00000100:00100000:0.0:1788572160.383799:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495316736 00000100:00100000:0.0:1788572160.383814:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495316736 00000100:00100000:0.0:1788572160.383857:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:0.0:1788572160.383869:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495316608:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572160.383968:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2355:x1875453495316608:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 101us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572160.383976:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:0.0:1788572160.383998:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00100000:0.0:1788572160.384005:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495316736:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572160.384041:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2356:x1875453495316736:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (4352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572160.384054:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00080000:3.0:1788572160.384632:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572160.384638:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572160.618382:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572160.618410:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518369152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572160.618505:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572160.618629:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518369152 00000100:00100000:2.0:1788572160.618639:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518369152 00000100:00100000:2.0:1788572160.618724:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788572160.618736:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518369152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572160.618782:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572160.618869:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518369152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572160.618877:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788572160.620598:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518369152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572160.744509:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572161.128596:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518369280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572161.128674:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572161.128825:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518369280 00000100:00100000:2.0:1788572161.128834:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518369280 00000100:00100000:2.0:1788572161.128894:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788572161.128904:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518369280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572161.128940:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572161.130561:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518369280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1650us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572161.130576:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788572161.130759:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518369280:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1788572161.686663:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788572161.686699:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788572161.686877:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788572161.686889:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1788572161.696188:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1788572161.770165:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572162.793019:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572163.817159:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572164.273564:0:12764:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:36:02 (1788572162) 00010000:00010000:3.0:1788572164.840405:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572165.225646:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518369792:0@lo:400:kworker.0 00000100:00100000:3.0:1788572165.226245:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518369408:0@lo:400:kworker.0 00000100:00100000:3.0:1788572165.234737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572165.234825:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518369920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572165.234849:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518369408 00000100:00100000:0.0:1788572165.234859:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518369408 00000100:00100000:3.0:1788572165.234877:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572165.234918:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518369664:0@lo:400:kworker.0 00000100:00100000:0.0:1788572165.234933:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788572165.234942:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518369408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572165.234946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572165.234967:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788572165.234973:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518369536:0@lo:400:kworker.0 00000100:00100000:3.0:1788572165.234992:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572165.235002:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3300:x1875453518369408:12345-0@lo:400:kworker.0 Request processed in 61us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572165.235008:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518370048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572165.235010:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788572165.235043:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572165.235073:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518369408:0@lo:400:kworker.0 00000100:00100000:0.0:1788572165.235095:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518370048 00000100:00100000:0.0:1788572165.235099:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518370048 00000100:00100000:0.0:1788572165.235132:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788572165.235138:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518370048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572165.235159:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518369920 00000100:00100000:3.0:1788572165.235163:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518369920 00000100:00100000:0.0:1788572165.235173:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518370048:12345-0@lo:400:kworker.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572165.235179:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788572165.235188:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518369664 00000100:00100000:3.0:1788572165.235191:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518369664 00000100:00080000:0.0:1788572165.235194:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572165.235198:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572165.235202:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518369536 00000100:00100000:3.0:1788572165.235204:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518369536 00000100:00100000:3.0:1788572165.235215:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788572165.235218:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518370048:0@lo:400:kworker.0 00000100:00100000:3.0:1788572165.235221:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518369920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572165.235284:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518369920:12345-0@lo:400:kworker.0 Request processed in 63us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572165.235290:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788572165.235303:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788572165.235308:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518369664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572165.235338:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518369664:12345-0@lo:400:kworker.0 Request processed in 30us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572165.235344:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788572165.235354:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788572165.235360:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07bfb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518369536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572165.235383:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07bfb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518369536:12345-0@lo:400:kworker.0 Request processed in 24us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572165.235388:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788572165.238637:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518369920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572165.238703:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518369536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572165.238729:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518369664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572165.239393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572165.241448:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518369792 00000100:00100000:2.0:1788572165.241462:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518369792 00000100:00100000:2.0:1788572165.241536:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788572165.241549:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518369792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572165.241656:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518369792:12345-0@lo:400:kworker.0 Request processed in 111us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572165.241673:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788572165.242518:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788572165.242525:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88c07ba40e00, transno 4294967324 00000100:00100000:1.0:1788572165.242539:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518369792:0@lo:400:kworker.0 00000100:00080000:3.0:1788572165.242995:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572165.464407:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572165.464448:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572165.464481:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572165.464499:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572165.464524:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572165.464554:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495317248 00000100:00100000:3.0:1788572165.464574:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495317248 00000100:00100000:3.0:1788572165.464633:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495317120 00000100:00100000:3.0:1788572165.464636:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495317120 00000100:00100000:3.0:1788572165.464658:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:3.0:1788572165.464680:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495317248:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572165.464764:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2354:x1875453495317248:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572165.464771:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:3.0:1788572165.464785:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:3.0:1788572165.464791:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2354:x1875453495317120:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572165.464812:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+7:2354:x1875453495317120:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 22us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572165.464818:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:3.0:1788572165.464836:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495316992 00000100:00100000:3.0:1788572165.464839:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495316992 00000100:00100000:3.0:1788572165.464861:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495317376 00000100:00100000:3.0:1788572165.464864:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495317376 00000100:00100000:3.0:1788572165.464876:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 183 00000100:00100000:3.0:1788572165.464881:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+18:2354:x1875453495316992:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572165.464919:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+18:2354:x1875453495316992:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 38us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572165.464924:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 183 00000100:00100000:3.0:1788572165.464935:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 184 00000100:00100000:3.0:1788572165.464940:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2354:x1875453495317376:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572165.464960:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2354:x1875453495317376:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 20us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572165.464971:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 184 00000100:00080000:3.0:1788572165.464987:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572165.464991:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572165.464993:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572165.465967:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495316864 00000100:00100000:1.0:1788572165.465977:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495316864 00000100:00100000:1.0:1788572165.466013:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 308 00000100:00100000:1.0:1788572165.466021:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2354:x1875453495316864:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572165.466069:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2354:x1875453495316864:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 49us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572165.466075:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 308 00000100:00100000:1.0:1788572165.737132:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518370176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572165.737206:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572165.739358:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518370176 00000100:00100000:3.0:1788572165.739375:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518370176 00000100:00100000:3.0:1788572165.739434:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788572165.739444:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518370176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572165.739482:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572165.739575:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518370176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572165.739583:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788572165.739730:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518370176:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572165.864697:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572166.249802:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518370304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572166.249876:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572166.249979:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518370304 00000100:00100000:0.0:1788572166.250000:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518370304 00000100:00100000:0.0:1788572166.250053:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788572166.250064:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518370304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572166.250097:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572166.250361:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518370304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 298us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572166.250369:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788572166.250527:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518370304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572166.890511:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572167.913273:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572168.860758:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572168.860964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495317632 00000100:00100000:2.0:1788572168.860975:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495317632 00000100:00100000:2.0:1788572168.861062:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:2.0:1788572168.861072:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+18:12349:x1875453495317632:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:2.0:1788572168.861628:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+19:12349:x1875453495317632:12345-192.168.202.2@tcp:35:umount.0 Request processed in 555us (878us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788572168.861636:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00080000:3.0:1788572168.862088:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572168.873287:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572168.874127:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495317888 00000100:00100000:2.0:1788572168.874141:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495317888 00000100:00100000:2.0:1788572168.874206:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:2.0:1788572168.874218:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+19:12349:x1875453495317888:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:2.0:1788572168.875385:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78708c10-ef63-4de2-8b1c-aff484c98227+20:12349:x1875453495317888:12345-192.168.202.2@tcp:35:umount.0 Request processed in 1160us (2133us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788572168.875400:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1788572168.879510:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572168.879594:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495318144 00000100:00100000:1.0:1788572168.879606:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495318144 00000100:00100000:1.0:1788572168.879683:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:1.0:1788572168.879695:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c050315c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+20:12349:x1875453495318144:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:1.0:1788572168.879960:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c050315c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+21:12349:x1875453495318144:12345-192.168.202.2@tcp:35:umount.0 Request processed in 266us (459us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788572168.879968:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:3.0:1788572168.882279:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572168.882405:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495318400 00000100:00100000:1.0:1788572168.882415:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495318400 00000100:00100000:1.0:1788572168.882512:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:1.0:1788572168.882524:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+21:12349:x1875453495318400:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:1.0:1788572168.883019:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78708c10-ef63-4de2-8b1c-aff484c98227+22:12349:x1875453495318400:12345-192.168.202.2@tcp:35:umount.0 Request processed in 497us (774us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788572168.883027:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:3.0:1788572168.887476:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572168.887528:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572168.887570:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572168.887596:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572168.887644:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495318656 00000100:00100000:0.0:1788572168.887797:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495318528 00000100:00100000:0.0:1788572168.887804:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495318528 00000100:00100000:0.0:1788572168.887878:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1788572168.887890:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+5:2352:x1875453495318528:12345-192.168.202.2@tcp:9:umount.0 00000020:00000080:0.0:1788572168.887921:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff8e0 00000100:00080000:0.0:1788572168.887931:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88c076c6a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572168.887968:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788572168.888279:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78708c10-ef63-4de2-8b1c-aff484c98227+2:2352:x1875453495318528:12345-192.168.202.2@tcp:9:umount.0 Request processed in 363us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572168.888286:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1788572168.888326:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495318912 00000100:00100000:0.0:1788572168.888329:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495318912 00000100:00100000:0.0:1788572168.888360:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495318784 00000100:00100000:0.0:1788572168.888363:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495318784 00000100:00100000:0.0:1788572168.888376:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:0.0:1788572168.888382:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae064e-d360-4402-a9f8-841f0545fa17+14:2354:x1875453495318912:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572168.888392:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572168.888409:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b90c00/0x977d9e7969bff81c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e4b expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572168.888424:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572168.888443:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae064e-d360-4402-a9f8-841f0545fa17+13:2354:x1875453495318912:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 61us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572168.888465:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:0.0:1788572168.888479:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788572168.888485:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae064e-d360-4402-a9f8-841f0545fa17+12:2354:x1875453495318784:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572168.888492:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572168.888502:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b91600/0x977d9e7969bff56e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d48 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572168.888510:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572168.888527:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae064e-d360-4402-a9f8-841f0545fa17+11:2354:x1875453495318784:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 43us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572168.888546:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:0.0:1788572168.888570:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572168.888597:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572168.888854:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495318656 00000100:00100000:3.0:1788572168.888892:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788572168.888899:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+11:2354:x1875453495318656:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572168.888907:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572168.888916:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2c00/0x977d9e7969bff608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d80 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.888933:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572168.888953:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2354:x1875453495318656:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 55us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572168.888960:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788572168.894772:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572168.894863:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495319296 00000100:00100000:2.0:1788572168.894874:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495319296 00000100:00100000:2.0:1788572168.894944:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:2.0:1788572168.894955:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+7:2352:x1875453495319296:12345-192.168.202.2@tcp:9:umount.0 00000020:00000080:2.0:1788572168.894985:0:11678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bffb41 00000020:00010000:2.0:1788572168.894992:0:11678:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88c04727f800: total 0 00000100:00080000:2.0:1788572168.894997:0:11678:0:(import.c:65:import_set_state_nolock()) ffff88c04727d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572168.895034:0:11678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788572168.895352:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78708c10-ef63-4de2-8b1c-aff484c98227+5:2352:x1875453495319296:12345-192.168.202.2@tcp:9:umount.0 Request processed in 399us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572168.895361:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000020:00010000:2.0:1788572168.895384:0:7624:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88c04727f800: total 0 00010000:00010000:2.0:1788572168.895403:0:7624:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88c04727f800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788572168.895452:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaadb370/0x977d9e7969bffee4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11020 expref: 4 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572168.895486:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2f679a/0x977d9e7969c00582 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111ee expref: 3 pid: 11678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572168.895502:0:7624:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88c04727f800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788572168.895528:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572168.895530:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572168.895532:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572168.896075:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572168.904632:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572168.904678:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495320320 00000100:00100000:3.0:1788572168.904687:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495320320 00000100:00100000:3.0:1788572168.904734:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 240 00000100:00100000:3.0:1788572168.904744:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+22:2352:x1875453495320320:12345-192.168.202.2@tcp:39:umount.0 00000020:00000080:3.0:1788572168.904777:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff57c 00000020:00010000:3.0:1788572168.904792:0:5831:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88bf47468000: total 0 00000100:00080000:3.0:1788572168.904796:0:5831:0:(import.c:65:import_set_state_nolock()) ffff88bf4746f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572168.904820:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788572168.905181:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78708c10-ef63-4de2-8b1c-aff484c98227+21:2352:x1875453495320320:12345-192.168.202.2@tcp:39:umount.0 Request processed in 436us (556us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788572168.905188:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 240 00000020:00010000:3.0:1788572168.905213:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88bf47468000: total 0 00010000:00010000:3.0:1788572168.905270:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88bf47468000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788572168.905304:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd600) 00010000:00010000:3.0:1788572168.905308:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572168.905316:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387000/0x977d9e7969bfff46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1103c expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905337:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bfe00) 00010000:00010000:3.0:1788572168.905354:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572168.905359:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969bff862 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e60 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905385:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572168.905388:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572168.905392:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969bffea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1100b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905459:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:3.0:1788572168.905462:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572168.905466:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111d9 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905479:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:3.0:1788572168.905482:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788572168.905485:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c0056d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111e7 expref: 16 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905496:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:3.0:1788572168.905498:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572168.905502:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076b90400/0x977d9e7969bff846 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e59 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905517:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572168.905519:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788572168.905523:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a200/0x977d9e7969bffecf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11019 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905549:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572168.905552:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788572168.905556:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00241 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11115 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905567:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:3.0:1788572168.905569:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788572168.905574:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387600/0x977d9e7969bff8b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e75 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905585:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88c0593ef500) 00010000:00010000:3.0:1788572168.905587:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572168.905591:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0de00/0x977d9e7969c00463 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111a1 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905605:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88c059bcde00) 00010000:00010000:3.0:1788572168.905619:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788572168.905624:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994c00/0x977d9e7969bffba3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10f47 expref: 10 pid: 10431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905641:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88c059bcd700) 00010000:00010000:3.0:1788572168.905643:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788572168.905647:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c041387400/0x977d9e7969bfff62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11043 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905660:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88c0593ef300) 00010000:00010000:3.0:1788572168.905663:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572168.905674:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995000/0x977d9e7969bffdc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10fd3 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572168.905688:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88bf47468000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788572168.905702:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572168.905705:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572168.905706:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572168.936578:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572169.001406:0:11683:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788572169.001415:0:11683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788572169.001856:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788572169.001863:0:11683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788572169.960563:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572170.344559:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518370688:0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.344660:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572170.344725:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572170.344732:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518370560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.344756:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572170.344775:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518371072:0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.344799:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572170.344868:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518370688 00000100:00100000:1.0:1788572170.344875:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518370688 00000100:00100000:1.0:1788572170.344922:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518370560 00000100:00100000:1.0:1788572170.344925:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518370560 00000100:00100000:1.0:1788572170.344944:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788572170.344954:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518370688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.345005:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518370688:12345-0@lo:400:kworker.0 Request processed in 52us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572170.345012:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788572170.345029:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788572170.345036:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518370560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.345061:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518370560:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572170.345067:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788572170.345105:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518370560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.345115:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518370688:0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.345139:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518371072 00000100:00100000:1.0:1788572170.345143:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518371072 00000100:00100000:1.0:1788572170.345170:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788572170.345178:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518371072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.345228:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518371072:12345-0@lo:400:kworker.0 Request processed in 52us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572170.345234:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788572170.345283:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518371072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572170.346723:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518370816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572170.346791:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572170.346852:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572170.346859:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518370432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572170.346889:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572170.346925:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518370944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572170.346951:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572170.347094:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518370944 00000100:00100000:2.0:1788572170.347101:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518370944 00000100:00100000:2.0:1788572170.347135:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788572170.347143:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518370944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572170.347193:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518370944:12345-0@lo:400:kworker.0 Request processed in 50us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572170.347200:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788572170.347757:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518370944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.347908:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518370432 00000100:00100000:1.0:1788572170.347914:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518370432 00000100:00100000:1.0:1788572170.347960:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788572170.347968:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518370432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572170.348019:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518370432:12345-0@lo:400:kworker.0 Request processed in 52us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572170.348027:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:3.0:1788572170.348047:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572170.348054:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572170.348072:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518370432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572170.348389:0:11678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518370816 00000100:00100000:0.0:1788572170.348394:0:11678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518370816 00000100:00100000:0.0:1788572170.348436:0:11678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788572170.348443:0:11678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518370816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572170.348481:0:11678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518370816:12345-0@lo:400:kworker.0 Request processed in 40us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572170.348488:0:11678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788572170.349030:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518370816:0@lo:400:kworker.0 00000100:00080000:3.0:1788572170.350396:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572170.587760:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572170.587807:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572170.587910:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495320576 00000100:00100000:1.0:1788572170.587920:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495320576 00000100:00100000:1.0:1788572170.587995:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 188 00000100:00100000:1.0:1788572170.588005:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2353:x1875453495320576:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788572170.588082:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2353:x1875453495320576:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572170.588090:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 188 00000100:00080000:2.0:1788572170.588239:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572170.588304:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495320448 00000100:00100000:3.0:1788572170.588309:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495320448 00000100:00100000:3.0:1788572170.588354:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 310 00000100:00100000:3.0:1788572170.588361:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2353:x1875453495320448:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572170.588386:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2353:x1875453495320448:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572170.588392:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 310 00000100:00100000:0.0:1788572170.856921:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572170.856950:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518371200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572170.857032:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572170.857194:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518371200 00000100:00100000:2.0:1788572170.857217:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518371200 00000100:00100000:2.0:1788572170.857297:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788572170.857306:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518371200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572170.857341:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572170.857396:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518371200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572170.857403:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788572170.857575:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518371200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572170.970308:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572170.970335:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572170.970379:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572170.970488:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495320704 00000100:00100000:2.0:1788572170.970495:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495320960 00000100:00100000:1.0:1788572170.970499:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495320704 00000100:00100000:2.0:1788572170.970502:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495320960 00000100:00100000:0.0:1788572170.970565:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495320832 00000100:00100000:0.0:1788572170.970593:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495320832 00000100:00100000:1.0:1788572170.970665:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:1.0:1788572170.970676:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4ae064e-d360-4402-a9f8-841f0545fa17+12:2353:x1875453495320704:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572170.970694:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572170.970713:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387800/0x977d9e7969bff64e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d95 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572170.970730:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572170.970782:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4ae064e-d360-4402-a9f8-841f0545fa17+11:2353:x1875453495320704:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 109us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572170.970799:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:2.0:1788572170.974123:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1788572170.974155:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+11:2355:x1875453495320960:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572170.974174:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572170.974195:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3a00/0x977d9e7969bff815 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10e44 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572170.974212:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572170.974287:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae064e-d360-4402-a9f8-841f0545fa17+10:2355:x1875453495320960:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 153us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572170.974295:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1788572170.975844:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:0.0:1788572170.975859:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+9:2353:x1875453495320832:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572170.975872:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572170.975888:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b90a00/0x977d9e7969bff655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10dbf expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572170.975904:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572170.975955:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4ae064e-d360-4402-a9f8-841f0545fa17+8:2353:x1875453495320832:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 102us (5576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572170.975962:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:3.0:1788572170.984430:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572170.984554:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495321216 00000100:00100000:0.0:1788572170.984566:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495321216 00000100:00100000:0.0:1788572170.984635:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 241 00000100:00100000:0.0:1788572170.984646:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+6:2352:x1875453495321216:12345-192.168.202.2@tcp:39:umount.0 00000020:00000080:0.0:1788572170.984690:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff663 00000020:00010000:0.0:1788572170.984999:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88c0484a9800: total 0 00000100:00080000:0.0:1788572170.985006:0:5832:0:(import.c:65:import_set_state_nolock()) ffff88c0484ad000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572170.985062:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788572170.985310:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a29edff0-34e1-4cac-beac-cd8589fdf9ee+5:2352:x1875453495321216:12345-192.168.202.2@tcp:39:umount.0 Request processed in 665us (888us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788572170.985318:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 241 00000020:00010000:3.0:1788572170.986235:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88c0484a9800: total 0 00010000:00010000:3.0:1788572170.986241:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572170.986299:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88c0484a9800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788572170.986332:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c059bcd600) 00010000:00010000:3.0:1788572170.986336:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572170.986345:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994200/0x977d9e7969c00590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb111f5 expref: 4 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572170.986392:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88c0484a9800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788572170.986404:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572170.986406:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572170.986408:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572170.986588:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572171.021179:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572171.021348:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495321472 00000100:00100000:1.0:1788572171.021358:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495321472 00000100:00100000:1.0:1788572171.021418:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 311 00000100:00100000:1.0:1788572171.021428:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+7:2352:x1875453495321472:12345-192.168.202.2@tcp:251:umount.0 00000020:00000080:1.0:1788572171.021469:0:5825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff559 00000020:00010000:1.0:1788572171.021478:0:5825:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88c058aad800: total 0 00000100:00080000:1.0:1788572171.021483:0:5825:0:(import.c:65:import_set_state_nolock()) ffff88c058aaa000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788572171.021552:0:7624:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88c058aad800: total 0 00010000:00010000:2.0:1788572171.021608:0:7624:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88c058aad800, canceled 0 locks, left on hash table 1. 00000100:00100000:1.0:1788572171.021634:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05035bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae064e-d360-4402-a9f8-841f0545fa17+3:2352:x1875453495321472:12345-192.168.202.2@tcp:251:umount.0 Request processed in 207us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572171.021641:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 311 00010000:00010000:2.0:1788572171.021707:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b91c00/0x977d9e7969bff60f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb10d87 expref: 2 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572171.021722:0:7624:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88c058aad800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788572171.021733:0:7624:0:(genops.c:885:class_export_put()) final put ffff88c058aad800/d4ae064e-d360-4402-a9f8-841f0545fa17 00010000:00010000:2.0:1788572171.021750:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572171.021764:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572171.021766:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788572171.021816:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c058aad800/d4ae064e-d360-4402-a9f8-841f0545fa17 for MGS 00000020:00000080:3.0:1788572171.021866:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c058aaa000 for MGS 00000100:00100000:3.0:1788572171.374955:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572171.376845:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518371328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572171.376945:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572171.377175:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518371328 00000100:00100000:1.0:1788572171.377184:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518371328 00000100:00100000:1.0:1788572171.377238:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788572171.377271:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518371328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572171.377307:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572171.377355:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518371328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572171.377362:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788572171.377411:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518371328:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788572171.980799:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a29edff0-34e1-4cac-beac-cd8589fdf9ee 00000001:00080000:3.0:1788572171.980818:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788572171.980825:0:5853:0:(genops.c:885:class_export_put()) final put ffff88c0484a9800/a29edff0-34e1-4cac-beac-cd8589fdf9ee 00000001:00080000:3.0:1788572171.980848:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1788572171.980869:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000001:00080000:3.0:1788572171.980877:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788572171.980879:0:5853:0:(genops.c:885:class_export_put()) final put ffff88bf47468000/78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:1.0:1788572171.981288:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0484a9800/a29edff0-34e1-4cac-beac-cd8589fdf9ee for lustre-MDT0000 00000020:00000080:1.0:1788572171.981345:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf47468000/78708c10-ef63-4de2-8b1c-aff484c98227 for lustre-MDT0000 00000020:00000080:1.0:1788572171.981372:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c0484ad000 for lustre-MDT0000 00000020:00000080:1.0:1788572171.981378:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88bf4746f800 for lustre-MDT0000 00010000:00010000:2.0:1788572172.010200:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788572172.022101:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:1.0:1788572172.022109:0:6703:0:(genops.c:885:class_export_put()) final put ffff88c04727f800/78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:3.0:1788572172.026816:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c04727f800/78708c10-ef63-4de2-8b1c-aff484c98227 for lustre-OST0000 00000020:00000080:3.0:1788572172.026877:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c04727d800 for lustre-OST0000 00000020:01000004:2.0:1788572172.561171:0:12962:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788572172.583118:0:12962:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788572172.583174:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.583189:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.583196:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.583203:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.583228:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788572172.583234:0:12962:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788572172.583283:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572172.583288:0:12962:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788572172.583293:0:12962:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788572172.583320:0:12962:0:(import.c:65:import_set_state_nolock()) ffff88c04755f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788572172.583407:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572172.583415:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.583421:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040031800 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572172.583425:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.583434:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572172.583452:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572172.583457:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788572172.583460:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788572172.583462:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788572172.583491:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.583497:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572172.583525:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.583533:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040031800/0x977d9e7969bff5de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff5e5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.583546:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572172.583548:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572172.583550:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572172.583567:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572172.583587:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518371584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572172.583663:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572172.584543:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518371456:0@lo:39:umount.0 00000100:00100000:3.0:1788572172.584598:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572172.584679:0:10431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518371456 00000100:00100000:1.0:1788572172.584688:0:10431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518371456 00000100:00100000:1.0:1788572172.584744:0:10431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788572172.584754:0:10431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875453518371456:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572172.584851:0:10431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff368 00000100:00080000:1.0:1788572172.584860:0:10431:0:(import.c:65:import_set_state_nolock()) ffff88c07bd49800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788572172.585080:0:10431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c05076b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3296:x1875453518371456:12345-0@lo:39:umount.0 Request processed in 327us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572172.585102:0:10431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788572172.585113:0:10431:0:(genops.c:885:class_export_put()) final put ffff88c06bfdc000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788572172.585267:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c06bfdc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788572172.585316:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c07bd49800 for lustre-MDT0000 00000100:00080000:3.0:1788572172.585350:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c04755f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788572172.585359:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518371456:0@lo:39:umount.0 00000100:00100000:2.0:1788572172.585597:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518371584 00000100:00100000:2.0:1788572172.585603:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518371584 00000100:00100000:2.0:1788572172.585648:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788572172.585656:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3299:x1875453518371584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572172.585676:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572172.585693:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041523600/0x977d9e7969bff5e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff5de expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.585709:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572172.585760:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3299:x1875453518371584:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572172.585766:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788572172.585902:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572172.585906:0:12962:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788572172.585980:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788572172.588069:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572172.588120:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518371584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572172.589381:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.589397:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.589405:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.589412:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.589467:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572172.589473:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.589479:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.589485:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.589491:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590511:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572172.590521:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590530:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040030400 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572172.590534:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590543:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572172.590550:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572172.590575:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572172.590578:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788572172.590613:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590618:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572172.590651:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590659:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040030400/0x977d9e7969bff5ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff5f3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590672:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572172.590675:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590680:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041522200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572172.590682:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590688:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572172.590694:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572172.590699:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572172.590701:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788572172.590713:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590724:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572172.590731:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.590749:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572172.590751:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572172.590753:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572172.590812:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518371840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572172.590884:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572172.590945:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572172.590952:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518371712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572172.590975:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572172.591009:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518371840 00000100:00100000:3.0:1788572172.591016:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518371840 00000100:00100000:3.0:1788572172.591054:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518371712 00000100:00100000:3.0:1788572172.591058:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518371712 00000100:00100000:3.0:1788572172.591081:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788572172.591088:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07b09b9b-dc48-4957-bfb2-5dac95d9db69+19:3298:x1875453518371840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572172.591101:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572172.591115:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3200/0x977d9e7969bff51a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff513 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.591137:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572172.591173:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07b09b9b-dc48-4957-bfb2-5dac95d9db69+18:3298:x1875453518371840:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572172.591180:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788572172.591226:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788572172.591232:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07b09b9b-dc48-4957-bfb2-5dac95d9db69+17:3298:x1875453518371712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572172.591240:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572172.591274:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b91a00/0x977d9e7969bff5f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff5ec expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.591283:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572172.591303:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3298:x1875453518371712:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572172.591317:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788572172.591354:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518371712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572172.591363:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518371840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572172.592418:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572172.592429:0:12962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041522200/0x977d9e7969bff513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff51a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572172.592447:0:12962:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788572172.592456:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.592463:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.592469:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.592475:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.592504:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572172.592510:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.592515:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b91e00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572172.592518:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.592525:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572172.592531:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572172.592536:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788572172.592538:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788572172.592572:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.592578:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572172.592610:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.592618:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572172.592620:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572172.592633:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572172.592676:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518371968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572172.592722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572172.592877:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518371968 00000100:00100000:3.0:1788572172.592884:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518371968 00000100:00100000:3.0:1788572172.592998:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788572172.593007:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07b09b9b-dc48-4957-bfb2-5dac95d9db69+16:3299:x1875453518371968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572172.593018:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572172.593030:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2800/0x977d9e7969bff80e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff807 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.593042:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572172.593074:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:3299:x1875453518371968:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572172.593081:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788572172.593229:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518371968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572172.593412:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572172.593419:0:12962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b91e00/0x977d9e7969bff807 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff80e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572172.593430:0:12962:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788572172.593438:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.593444:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.593451:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.593467:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.593496:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572172.593502:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.593508:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387c00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572172.593511:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.593518:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572172.593525:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572172.593530:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572172.593532:0:7624:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1788572172.593549:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.593576:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788572172.593616:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518372096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572172.593651:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572172.593707:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572172.593715:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572172.593717:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572172.593719:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572172.593762:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518372096 00000100:00100000:3.0:1788572172.593767:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518372096 00000100:00100000:3.0:1788572172.593812:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788572172.593820:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+15:3300:x1875453518372096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572172.593829:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572172.593841:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db3c00/0x977d9e7969bff2ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff2c7 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572172.593854:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572172.593890:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572172.593895:0:12962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969bff2c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff2ce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572172.593904:0:12962:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1788572172.593917:0:12962:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788572172.593920:0:12962:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788572172.593955:0:12962:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788572172.593958:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788572172.593962:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572172.593967:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788572172.593972:0:12962:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff88c07f74b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572172.593977:0:12962:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff88c07f748000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572172.593981:0:12962:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff88c0485819c0) has exports, disconnecting them 00000020:00080000:1.0:1788572172.593985:0:12962:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88c07f74b800), last request at 1788572170 00000020:00000080:1.0:1788572172.593991:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff4db 00000100:00080000:1.0:1788572172.594007:0:12962:0:(import.c:65:import_set_state_nolock()) ffff88c07f74e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788572172.594057:0:12962:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c07f74b800): rc 0 00000020:00000080:1.0:1788572172.594060:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07f74b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788572172.594070:0:12962:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88c07f748000), last request at 1788572170 00000020:00000080:1.0:1788572172.594072:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff410 00000100:00080000:1.0:1788572172.594078:0:12962:0:(import.c:65:import_set_state_nolock()) ffff88c07f749000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788572172.594092:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07f74b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572172.594129:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c07f74e000 for lustre-MDT0000 00000020:00080000:1.0:1788572172.594150:0:12962:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c07f748000): rc 0 00000020:00000080:1.0:1788572172.594152:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07f748000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788572172.594163:0:12962:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac68c17cbae0 00000020:00000080:1.0:1788572172.594173:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07f748000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572172.594197:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c07f749000 for lustre-MDT0000 00000100:00080000:1.0:1788572172.594217:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572172.594221:0:12962:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788572172.594232:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788572172.594342:0:12962:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788572172.594357:0:12962:0:(import.c:65:import_set_state_nolock()) ffff88c0484ab800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788572172.594369:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572172.594372:0:12962:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788572172.594379:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788572172.594443:0:12962:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788572172.594453:0:12962:0:(import.c:65:import_set_state_nolock()) ffff88bf4531b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788572172.594483:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff88c0485819c0) has no exports 00010000:00010000:2.0:1788572172.594699:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572172.594792:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572172.595364:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518372224:0@lo:9:umount.0 00000100:00100000:1.0:1788572172.595414:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572172.595442:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518372352:0@lo:9:umount.0 00000100:00100000:1.0:1788572172.595462:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572172.595496:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518372224 00000100:00100000:1.0:1788572172.595502:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518372224 00000100:00100000:1.0:1788572172.595542:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518372352 00000100:00100000:1.0:1788572172.595545:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518372352 00000100:00100000:1.0:1788572172.595579:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788572172.595587:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875453518372224:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788572172.595610:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff45d 00000100:00080000:1.0:1788572172.595617:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88bf4530f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572172.595655:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788572172.596130:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3296:x1875453518372224:12345-0@lo:9:umount.0 Request processed in 542us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572172.596137:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788572172.596157:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788572172.596163:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875453518372352:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788572172.596177:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff544 00000100:00080000:1.0:1788572172.596183:0:6679:0:(import.c:65:import_set_state_nolock()) ffff88bf4746d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572172.596204:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788572172.596321:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3296:x1875453518372352:12345-0@lo:9:umount.0 Request processed in 158us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572172.596328:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788572172.596366:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0484ab800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788572172.596377:0:3296:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788572172.596379:0:3296:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572172.596382:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518372224:0@lo:9:umount.0 00000100:00080000:1.0:1788572172.596391:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf4531b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788572172.596398:0:3296:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788572172.596399:0:3296:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572172.596402:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518372352:0@lo:9:umount.0 00010000:00010000:1.0:1788572172.596439:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572172.597216:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07b09b9b-dc48-4957-bfb2-5dac95d9db69+14:3300:x1875453518372096:12345-0@lo:103:ldlm_bl.0 Request processed in 3392us (3558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572172.597226:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788572172.597477:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3300:1875453518372096:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788572172.598110:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572172.598117:0:5826:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572172.598131:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572172.598138:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788572172.604120:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff88c0485819c0) has no exports 00000020:00000080:3.0:1788572172.682448:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff322 00000020:00000080:3.0:1788572172.682465:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07b80e800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788572172.682485:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788572172.682652:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572172.682664:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788572172.682669:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff88c047508000) has no exports 00000020:00000080:1.0:1788572172.683172:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07b80e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788572172.683226:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff31b 00000020:00000080:2.0:1788572172.683233:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c0503c8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788572172.683314:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572172.683322:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788572172.683325:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c074cbd800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788572172.683328:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074cbd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788572172.683335:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788572172.689494:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0503c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788572172.689883:0:12962:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c06751d900 - data ffff88c07ffbb870/ffff88c076668000 00000020:01000000:2.0:1788572172.690062:0:12962:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c0514e4600 - data ffff88c070446ca8/ffff88c07b801c00 00000001:00000004:2.0:1788572172.707456:0:12962:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788572172.792493:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788572172.792503:0:12962:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788572172.792526:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572172.792543:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788572172.793019:0:7093:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788572172.793024:0:7093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788572172.793037:0:7093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788572172.794027:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788572172.794032:0:12962:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788572172.794050:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572172.794053:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788572172.794767:0:8033:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788572172.794771:0:8033:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788572172.794859:0:8033:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788572172.840725:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff2ea 00000020:00000080:1.0:1788572172.840743:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07c55c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572172.841875:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c55c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572172.842402:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff2ff 00000020:00000080:1.0:1788572172.842411:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07c55e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572172.842454:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788572172.842459:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572172.842467:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572172.842471:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff88c048580000) has no exports 00000004:01000000:1.0:1788572172.842703:0:12962:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788572172.842712:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff53d 00000020:00000080:1.0:1788572172.842716:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c0513c4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572172.843108:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c55e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788572172.843158:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788572172.843162:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572172.843169:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572172.843172:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff88c0485499c0) has no exports 00000020:00000080:1.0:1788572172.843178:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff536 00000020:00000080:1.0:1788572172.843183:0:12962:0:(genops.c:885:class_export_put()) final put ffff88bf45318800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788572172.843535:0:12962:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788572172.843541:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572172.843545:0:12962:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788572172.843562:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572172.843564:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788572172.843677:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0513c4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788572172.843684:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf45318800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572172.843692:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88bf4531b000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788572172.843724:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572172.843731:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572172.843734:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c0513c6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572172.843736:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0513c6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788572172.843741:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572172.843867:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff456 00000020:00000080:1.0:1788572172.843872:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07c543800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572172.843884:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788572172.843887:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572172.843899:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572172.843901:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff88c058ee8000) has no exports 00000020:00000080:1.0:1788572172.843906:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff44f 00000020:00000080:1.0:1788572172.843909:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c0484ae000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788572172.844215:0:12962:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788572172.844218:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572172.844221:0:12962:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788572172.844224:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572172.844225:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572172.844272:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572172.844276:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572172.844303:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572172.844306:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572172.844309:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c06bfd8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572172.844312:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff88c06bfd8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788572172.844316:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572172.844439:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff306 00000020:00000080:1.0:1788572172.844444:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07c55d800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788572172.844450:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788572172.844452:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572172.844455:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572172.844458:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff88c048584d40) has no exports 00000020:00000080:1.0:1788572172.844474:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572172.844477:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788572172.844479:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff30d 00000020:00000080:1.0:1788572172.844481:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07c55a000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788572172.844488:0:12962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c065ad2800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788572172.844491:0:12962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c065ad2800 3 00000020:01000004:1.0:1788572172.844494:0:12962:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88c065ad2800 from lustre-MDT0000 00000020:00000080:1.0:1788572172.844510:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572172.844512:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788572172.844515:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07c55b800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788572172.844521:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c55b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788572172.844530:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788572172.844566:0:12962:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788572172.844570:0:12962:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788572172.844573:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788572172.844575:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572172.844578:0:12962:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788572172.844585:0:12962:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff88c04751b000 07b09b9b-dc48-4957-bfb2-5dac95d9db69 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572172.844590:0:12962:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff88c048583380) has exports, disconnecting them 00000020:00000080:0.0:1788572172.844692:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c543800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572172.844699:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0484ae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572172.844704:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c0484ab800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572172.844708:0:8:0:(genops.c:885:class_export_put()) final put ffff88c0484ac000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572172.844710:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0484ac000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788572172.844714:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572172.844820:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c55d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788572172.844831:0:8:0:(genops.c:885:class_export_put()) final put ffff88c07c55a800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788572172.844833:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c55a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788572172.844836:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788572172.844981:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c55a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1788572172.845362:0:12962:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff88c04751b000), last request at 1788571925 00000020:00000080:1.0:1788572172.845380:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff2ab 00000020:00010000:1.0:1788572172.845385:0:12962:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88c04751b000: total 0 00000100:00080000:1.0:1788572172.845388:0:12962:0:(import.c:65:import_set_state_nolock()) ffff88c04751c000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788572172.845443:0:12962:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c04751b000): rc 0 00000020:00080000:1.0:1788572172.845448:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff88c048583380) has no exports 00000100:00100000:1.0:1788572172.845515:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff88c0474e5400:5825] 2 exiting: rc = 0 00000100:00100000:2.0:1788572172.847681:0:5823:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff88c058f10600:5823] 0 exiting: rc = 1 00000100:00100000:3.0:1788572172.847955:0:5824:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff88c047449600:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1788572172.848305:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848315:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848321:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848328:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848333:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848341:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848346:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848351:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848357:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848364:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848369:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848376:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848382:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848389:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848394:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848401:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848406:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848425:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848431:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848437:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848443:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848449:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848455:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848461:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848466:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848472:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848476:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848481:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848488:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848493:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848498:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848504:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848509:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848514:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848519:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848523:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848528:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848532:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848537:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848542:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848557:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848565:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848570:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848576:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848581:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848586:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848664:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848672:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848678:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848683:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848689:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848695:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848709:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848714:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848719:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848724:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848730:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848735:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848740:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848746:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848752:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848757:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848762:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.848767:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1788572172.849179:0:5818:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88c04751b000: total 0 20000000:01000000:1.0:1788572172.849207:0:12962:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788572172.849210:0:12962:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1788572172.849289:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88c04751b000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788572172.849319:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0d800/0x977d9e7969bff7f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff7eb expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.849336:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030a00/0x977d9e7969bff5d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff5d0 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.849346:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041522600/0x977d9e7969bff601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff5fa expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.849356:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c046db2200/0x977d9e7969bff800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff7f9 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.849369:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041386e00/0x977d9e7969bff3c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff3bc expref: 5 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.849380:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040030200/0x977d9e7969bff5ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff5a6 expref: 4 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.849400:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076b91400/0x977d9e7969bff5bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff5b4 expref: 3 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.849409:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c040031000/0x977d9e7969bff5c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x977d9e7969bff5c2 expref: 2 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572172.849420:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88c04751b000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788572172.849433:0:5818:0:(genops.c:885:class_export_put()) final put ffff88c04751b000/07b09b9b-dc48-4957-bfb2-5dac95d9db69 00010000:00010000:1.0:1788572172.849449:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572172.849452:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572172.849453:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572172.849646:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c04751b000/07b09b9b-dc48-4957-bfb2-5dac95d9db69 for MGS 00000020:00000080:2.0:1788572172.850412:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c04751c000 for MGS 00000020:01000000:1.0:1788572172.850454:0:12962:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c059b9a600 - data ffff88c07fed3ca8/ffff88bf4665f000 00000020:01000000:1.0:1788572172.850579:0:12962:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c04715e540 - data ffff88c0663b8510/ffff88c047473400 00000020:00000080:1.0:1788572172.851347:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff28f 00000020:00000080:1.0:1788572172.851355:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c058f71800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788572172.851378:0:12962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c065ad2800 from MGS, refs=2 00000020:01000004:1.0:1788572172.851381:0:12962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c065ad2800 2 00000020:01000004:1.0:1788572172.851384:0:12962:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88c065ad2800 from MGS 00000020:00000080:1.0:1788572172.851406:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572172.851441:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c058f71800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788572172.852427:0:12962:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788572172.852434:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c058f74000/MGS 00000020:00000080:1.0:1788572172.852438:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff88c058f74000/MGS for MGS 00000020:01000000:1.0:1788572172.852445:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788572172.852505:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788572172.852509:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572172.852514:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788572172.852522:0:12962:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff88c074cbb800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572172.852527:0:12962:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff88c0764819c0) has exports, disconnecting them 00000020:00080000:1.0:1788572172.852532:0:12962:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff88c074cbb800), last request at 1788571926 00000020:00000080:1.0:1788572172.852546:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff35a 00000020:00080000:1.0:1788572172.852567:0:12962:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c074cbb800): rc 0 00000020:00000080:1.0:1788572172.852572:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c074cbb800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788572172.856519:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c074cbb800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788572172.857671:0:12962:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788572172.857678:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788572172.857683:0:12962:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788572172.857689:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572172.857848:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c04755f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788572172.858004:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572172.858013:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788572172.858019:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c07c559000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788572172.858022:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c559000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788572172.858029:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788572172.858109:0:12962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c065ad2800 1 00000020:00000080:0.0:1788572172.858117:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff281 00000020:00000080:0.0:1788572172.858124:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c058f71000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788572172.858135:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788572172.858140:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572172.858144:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788572172.858148:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff88c058ee99c0) has no exports 00000020:00000080:2.0:1788572172.858184:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c058f71000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572172.912464:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572172.912845:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788572172.912851:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c065ad7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572172.912855:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff88c065ad7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788572172.912868:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788572172.913152:0:12962:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88c065ad4800 00000020:01000000:0.0:1788572172.913178:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788572172.913182:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572172.913187:0:12962:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788572172.913192:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff88c04750b380) has no exports 00000100:00100000:0.0:1788572172.913290:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff88c05032da00:5832] 2 exiting: rc = 0 00000100:00100000:1.0:1788572172.913489:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff88c047514800:5831] 1 exiting: rc = 0 00000100:00100000:3.0:1788572172.913495:0:5830:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff88c047515000:5830] 0 exiting: rc = 1 00000100:00100000:1.0:1788572172.913570:0:10431:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff88c076c5d200:10431] 3 exiting: rc = 0 00000100:00100000:0.0:1788572172.913891:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913899:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913905:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913910:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913915:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913920:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913926:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913931:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913937:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913941:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913947:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913953:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913958:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913963:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913968:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913985:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913991:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.913996:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914002:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914008:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914013:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914018:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914023:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914029:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914034:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914039:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914044:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914049:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914054:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914059:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914066:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914072:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914078:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914083:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914088:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914094:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914099:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914104:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914109:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914114:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914119:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914124:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914129:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914135:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914139:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914144:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914150:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914155:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914161:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914166:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914178:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914184:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914189:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914194:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914201:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914207:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914213:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914218:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914224:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914238:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914243:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914280:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914286:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.914291:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572172.923395:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff88c05032c400:5833] 0 exiting: rc = 1 00000100:00100000:1.0:1788572172.923658:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff88c05032dc00:5834] 1 exiting: rc = 0 00000100:00100000:0.0:1788572172.923923:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.923932:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.923937:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.923944:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.923950:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.923959:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.923967:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.923973:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.923994:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924000:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924008:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924013:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924020:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924026:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924031:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924035:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924041:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924046:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924051:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924057:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924062:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924079:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924084:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924105:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924110:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924117:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924123:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924127:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924132:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924136:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924176:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924182:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924187:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924191:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924196:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924200:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924205:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924210:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924215:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924219:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924223:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924228:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924236:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924240:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924244:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924263:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924268:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924273:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924277:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924281:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924286:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924290:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924294:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924307:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924313:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924318:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924328:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924333:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924339:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924344:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924349:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924354:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924358:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924362:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.924797:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff88c047572200:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1788572172.925123:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff88c047572e00:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1788572172.925376:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925382:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925392:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925397:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925414:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925423:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925429:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925435:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925441:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925582:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925589:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925596:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925603:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925609:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925614:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925619:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925696:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925709:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925853:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925861:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925867:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925878:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925886:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925893:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925902:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925908:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925925:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925931:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925954:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925962:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.925967:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926148:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926156:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926161:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926166:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926172:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926181:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926188:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926196:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926403:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926423:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926430:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926438:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926444:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926450:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926456:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926461:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926466:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926470:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926474:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926477:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926481:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926495:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926502:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926506:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926511:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926515:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926519:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926523:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926531:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926535:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926555:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926563:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.926570:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572172.936068:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff88c047573000:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1788572172.936184:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff88c052662400:5838] 1 exiting: rc = 0 00000100:00100000:1.0:1788572172.938016:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938026:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938032:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938037:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938043:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938048:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938053:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938058:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938064:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938069:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938074:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938080:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938085:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938090:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938095:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938100:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938104:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938109:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938114:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938118:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938123:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938128:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938135:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938140:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938144:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938149:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938171:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938176:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938180:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938185:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938189:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938193:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938198:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938202:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938207:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938212:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938216:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938221:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938225:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938230:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938234:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938408:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938418:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938423:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938428:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938433:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938437:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938652:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938660:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938665:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938670:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938674:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938679:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938683:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938688:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938693:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938697:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938701:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938706:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938711:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938715:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938726:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938730:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.938951:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.939680:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff88c052662000:5840] 1 exiting: rc = 0 00000100:00100000:2.0:1788572172.939982:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff88c052663200:5839] 0 exiting: rc = 1 00000100:00100000:0.0:1788572172.940085:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940092:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940097:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940101:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940106:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940113:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940117:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940122:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940126:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940131:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940136:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940148:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940193:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940202:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940207:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940212:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940217:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940221:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940226:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940231:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940236:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940241:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940373:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940381:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940385:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940390:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940395:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940400:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940404:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940409:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940414:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940433:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940437:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940484:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940490:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940495:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940501:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940506:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940511:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940515:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940521:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940527:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940533:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940538:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940544:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940558:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940564:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940568:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940573:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940578:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940583:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940588:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940593:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940599:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940605:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940610:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940614:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940620:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940625:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940631:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940636:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940641:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940646:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.940651:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572172.941428:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff88c0514e6a00:5842] 1 exiting: rc = 0 00000100:00100000:0.0:1788572172.941635:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff88c0514e7a00:5841] 0 exiting: rc = 1 00000100:00100000:1.0:1788572172.941731:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941859:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941863:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941869:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941874:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941879:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941883:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941888:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941893:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941897:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941976:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941982:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941986:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941991:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941995:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.941999:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942004:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942008:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942014:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942018:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942023:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942028:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942033:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942037:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942042:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942047:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942052:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942056:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942060:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942065:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942069:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942084:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942089:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942094:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942098:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942103:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942108:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942112:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942118:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942122:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942127:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942133:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942139:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942145:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942152:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942158:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942163:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942167:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942172:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942177:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942182:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942187:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942192:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942197:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942202:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942207:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942212:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942217:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942223:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942228:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942234:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942239:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942244:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572172.942404:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788572172.943227:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff88c052650200:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1788572172.943597:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff88c052651a00:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1788572172.944500:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff88c052651000:5845] 2 exiting: rc = 0 00000100:00100000:0.0:1788572172.946879:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.946889:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.946897:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949134:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949152:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949158:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949163:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949167:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949173:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949178:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949186:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949191:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949196:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949201:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949206:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949210:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949215:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949220:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949238:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949244:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949568:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949576:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949582:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949587:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949593:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949599:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949606:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949612:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949617:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949624:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949630:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949636:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949641:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949647:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949653:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949674:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949680:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949684:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949690:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949695:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949699:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949706:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949724:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949731:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949745:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949751:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949756:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949762:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.949768:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950377:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950390:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950395:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950400:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950406:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950411:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950417:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950422:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950428:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950435:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950456:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950464:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950470:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950476:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572172.950481:0:12962:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788572172.958451:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572172.958464:0:12962:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788572172.958469:0:12962:0:(genops.c:885:class_export_put()) final put ffff88c0503cb800/MDS_uuid 00000020:00000080:0.0:1788572172.958474:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0503cb800/MDS_uuid for MDS 00000020:01000000:0.0:1788572172.958479:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788572172.958609:0:12962:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788572173.037722:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788572174.004240:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78708c10-ef63-4de2-8b1c-aff484c98227 00000020:00000080:3.0:1788572174.004266:0:7635:0:(genops.c:885:class_export_put()) final put ffff88c076c6e800/78708c10-ef63-4de2-8b1c-aff484c98227 00000001:00100000:3.0:1788572174.004286:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572174.004288:0:7635:0:(genops.c:885:class_export_put()) final put ffff88bf4746e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572174.004300:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88c076c6e800/78708c10-ef63-4de2-8b1c-aff484c98227 for lustre-OST0001 00000020:00000080:3.0:1788572174.004333:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4746e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788572174.004346:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c076c6a800 for lustre-OST0001 00000020:00000080:3.0:1788572174.004351:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88bf4746d800 for lustre-OST0001 00010000:00010000:2.0:1788572174.076189:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572175.080793:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572175.465779:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518372608:0@lo:400:kworker.0 00000400:00000100:3.0:1788572175.465861:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518372608 offset 0 length 224: 4 00000100:00100000:2.0:1788572175.466018:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518372736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572175.466033:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572175.466038:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518372480:0@lo:400:kworker.0 00000400:00000100:2.0:1788572175.466042:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518372736 offset 0 length 224: 4 00000400:00000100:3.0:1788572175.466056:0:3298:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875453518372480 offset 0 length 224: 4 00000020:01000004:0.0:1788572176.052848:0:13112:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788572176.070715:0:13112:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788572176.070774:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572176.070949:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572176.070957:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572176.070965:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572176.070989:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788572176.070995:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788572176.071019:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788572176.071033:0:13112:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88bf476baa00 x1875453518372608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572176.071049:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788572176.071055:0:13112:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1788572176.071057:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788572176.071061:0:13112:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788572176.071064:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041523800 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572176.071068:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572176.071076:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572176.071082:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788572176.071086:0:13112:0:(import.c:65:import_set_state_nolock()) ffff88c076338000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:3.0:1788572176.071103:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788572176.071106:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788572176.071109:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788572176.071134:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572176.071141:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572176.071163:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572176.071170:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041523800/0x977d9e7969bff5c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x977d9e7969bff5c9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572176.071179:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788572176.071183:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572176.071184:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572176.071186:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572176.071195:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518372992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572176.071286:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572176.071491:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518372992 00000100:00100000:3.0:1788572176.071508:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518372992 00000100:00100000:3.0:1788572176.071641:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788572176.071650:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3299:x1875453518372992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788572176.071657:0:11167:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788572176 with bad export cookie 10916055316118368939 00000100:00100000:1.0:1788572176.072486:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518372608:0@lo:400:kworker.0 00000100:00100000:1.0:1788572176.072528:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518372864:0@lo:39:umount.0 00000400:00000100:1.0:1788572176.072704:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518372864 offset 0 length 224: 4 00000100:00100000:0.0:1788572176.083548:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3299:x1875453518372992:12345-0@lo:103:ldlm_bl.0 Request processed in 11887us (12252us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788572176.083564:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788572176.083655:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572176.083662:0:3299:0:(import.c:65:import_set_state_nolock()) ffff88c0503cf800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788572176.083665:0:3299:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788572176.093197:0:3299:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.102@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788572176.093203:0:3299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788572176.093214:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88bf476b9180 x1875453518372480/t0(0) o400->MGC192.168.202.102@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572176.093277:0:3299:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88bf476b9880 x1875453518372992/t0(0) o103->MGC192.168.202.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788572192 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788572176.093287:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788572176.093290:0:3299:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788572176.093292:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788572176.093295:0:3299:0:(import.c:65:import_set_state_nolock()) ffff88c0503cf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572176.093300:0:3299:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 146 00000100:00080000:2.0:1788572176.093309:0:3299:0:(import.c:665:import_select_connection()) MGC192.168.202.102@tcp: import ffff88c0503cf800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788572176.093611:0:3299:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c07ba40a80 x1875453518373120/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572176.093665:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3299:1875453518372992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572176.094873:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3298:1875453518372480:0@lo:400:kworker.0 00000100:00100000:2.0:1788572176.095477:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3296:1875453518373120:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1788572176.095551:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875453518373120 offset 0 length 520: 4 00010000:00010000:2.0:1788572176.104402:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788572177.050731:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572177.050742:0:6703:0:(genops.c:885:class_export_put()) final put ffff88bf4530c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572177.050854:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4530c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788572177.050923:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88bf4530f800 for lustre-OST0000 00010000:00010000:1.0:1788572177.129993:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572178.152477:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572179.176466:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572180.200774:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572180.584709:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572180.584746:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788572180.585006:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518373248:0@lo:400:kworker.0 00000400:00000100:1.0:1788572180.585065:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518373248 offset 0 length 224: 4 00010000:00010000:3.0:1788572181.224851:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572182.249007:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572183.272565:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572184.300953:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572185.320442:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572185.704679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572185.704691:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788572185.704909:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572185.704933:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518373376:0@lo:400:kworker.0 00000400:00000100:1.0:1788572185.704990:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518373376 offset 0 length 224: 4 00000100:00100000:1.0:1788572186.216801:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572176/real 1788572176] req@ffff88c07ba40a80 x1875453518373120/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572186 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572186.216833:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88c07ba40a80 x1875453518373120/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572186 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572186.216844:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572176/real 1788572176] req@ffff88c07ba41f80 x1875453518372864/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788572186 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572186.216855:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88c07ba41f80 x1875453518372864/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788572186 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572186.216867:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0503cf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572186.216885:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788572186.216889:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3296:1875453518373120:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788572186.216909:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c076338000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788572186.216930:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518372864:0@lo:39:umount.0 00000100:00080000:3.0:1788572186.217011:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572186.217016:0:13112:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788572186.217020:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788572186.217901:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.217916:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.217924:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.217931:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.217958:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572186.217966:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.217973:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.217979:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.217985:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.218000:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788572186.218005:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788572186.218028:0:13112:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788572186.218032:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788572186.218036:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572186.218041:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788572186.218054:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff88c058eecd40) has no exports 00000020:00080000:3.0:1788572186.218079:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff88c058eecd40) has no exports 00000020:01000000:3.0:1788572186.219752:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c059b9ab40 - data ffff88c07fed3948/ffff88c07b6c0000 00000020:01000000:3.0:1788572186.219877:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c050702840 - data ffff88c0663ee360/ffff88bf456b7400 00010000:00010000:3.0:1788572186.220181:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572186.220190:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.220204:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041522a00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572186.220208:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.220220:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572186.220227:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572186.220232:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788572186.220235:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788572186.220238:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788572186.220299:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c0503cf800 00010000:00010000:3.0:1788572186.220303:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.220310:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041522a00/0x977d9e7969bff5d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff5d7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.220323:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572186.220327:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572186.220756:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572186.220822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572186.220827:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788572186.220831:0:37:0:(import.c:65:import_set_state_nolock()) ffff88c0503cf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572186.220838:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 396 00000100:00080000:0.0:1788572186.220844:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.102@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572186.220849:0:37:0:(import.c:665:import_select_connection()) MGC192.168.202.102@tcp: import ffff88c0503cf800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788572186.220883:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c07ba40000 x1875453518373504/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572186.220956:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572186.220976:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518373632:0@lo:400:kworker.0 00000400:00000100:0.0:1788572186.221034:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518373632 offset 0 length 224: 4 00000100:00100000:1.0:1788572186.221144:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3296:1875453518373504:0@lo:250:kworker.0 00000400:00000100:1.0:1788572186.221167:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875453518373504 offset 0 length 520: 4 00010000:00010000:3.0:1788572186.224518:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076b90200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572186.224533:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.224544:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572186.224551:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572186.224557:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788572186.224560:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788572186.224563:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788572186.224586:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c0503cf800 00010000:00010000:3.0:1788572186.224590:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.224598:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076b90200/0x977d9e7969bff7f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff800 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572186.224613:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572186.224615:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572186.224618:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788572186.235102:0:13112:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788572186.257532:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff3df 00000020:00000080:2.0:1788572186.257546:0:13112:0:(genops.c:885:class_export_put()) final put ffff88bf4531b800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788572186.257564:0:13112:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c0503c8800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788572186.257568:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c0503c8800 2 00000020:01000004:2.0:1788572186.257582:0:13112:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88c0503c8800 from lustre-OST0000 00000020:00000080:2.0:1788572186.257609:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572186.257622:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788572186.257625:0:13112:0:(genops.c:885:class_export_put()) final put ffff88c076338800/lustre-OST0000_UUID 00000020:00000080:2.0:1788572186.257629:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff88c076338800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788572186.257637:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788572186.257680:0:13112:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788572186.257684:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788572186.257688:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572186.257706:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788572186.257713:0:13112:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff88c07f748800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572186.257719:0:13112:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff88c058eeb380) has exports, disconnecting them 00000020:00080000:2.0:1788572186.257724:0:13112:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff88c07f748800), last request at 1788571946 00000020:00000080:2.0:1788572186.257728:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff409 00000020:00080000:2.0:1788572186.257737:0:13112:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c07f748800): rc 0 00000020:00000080:2.0:1788572186.257743:0:13112:0:(genops.c:885:class_export_put()) final put ffff88c07f748800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788572186.258918:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788572186.258943:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07f748800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788572186.259191:0:13112:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788572186.259197:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572186.259201:0:13112:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788572186.259207:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788572186.259443:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c076338000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788572186.259638:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572186.259656:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788572186.259661:0:13112:0:(genops.c:885:class_export_put()) final put ffff88bf4531a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788572186.259664:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788572186.259672:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788572186.259720:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c0503c8800 1 00000020:00000080:3.0:1788572186.259726:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff399 00000020:00000080:3.0:1788572186.259731:0:13112:0:(genops.c:885:class_export_put()) final put ffff88c07bd4d000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788572186.259748:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788572186.259752:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572186.259756:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572186.259759:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff88c0475099c0) has no exports 00000020:00000080:0.0:1788572186.260066:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07bd4d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788572186.276871:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572186.276889:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788572186.276897:0:13112:0:(genops.c:885:class_export_put()) final put ffff88c07c55f800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788572186.276902:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07c55f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788572186.276914:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788572186.277080:0:13112:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88c07c55f000 00000020:02000400:0.0:1788572186.277126:0:13112:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788572186.410201:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572187.438986:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572188.457662:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788572189.028822:0:13266:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788572189.041547:0:13266:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788572189.041634:0:13266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572189.041648:0:13266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572189.041656:0:13266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572189.041664:0:13266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572189.041689:0:13266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788572189.041695:0:13266:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788572189.041723:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572189.041734:0:13266:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88bf476ba680 x1875453518372736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572189.041751:0:13266:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c07ba42300 x1875453518373248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572196 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572189.041782:0:13266:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c07ba43100 x1875453518373376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572201 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572189.041790:0:13266:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c07ba42a00 x1875453518373632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572202 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572189.041800:0:13266:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788572189.041834:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518372736:0@lo:400:kworker.0 00000100:00080000:3.0:1788572189.041862:0:13266:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788572189.041885:0:13266:0:(import.c:65:import_set_state_nolock()) ffff88c0513c7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788572189.041961:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572189.041968:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572189.041977:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041522400 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:1.0:1788572189.041980:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572189.041990:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572189.041997:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572189.042003:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788572189.042006:0:7624:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788572189.042008:0:7624:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788572189.042021:0:7624:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c0503cf800 00010000:00010000:1.0:1788572189.042024:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572189.042031:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041522400/0x977d9e7969bff5a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff5ad expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572189.042049:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572189.042051:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572189.042053:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572189.042070:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518373376:0@lo:400:kworker.0 00000100:00100000:1.0:1788572189.042078:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518373248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572189.042110:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518373632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572189.042621:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518373760:0@lo:39:umount.0 00000400:00000100:1.0:1788572189.042665:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875453518373760 offset 0 length 224: 4 00010000:00010000:1.0:1788572189.480774:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572190.504676:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572191.336846:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572191.336857:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788572191.529071:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572192.556037:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572193.576541:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572194.601007:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572195.637186:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572196.456519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572196.456532:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788572196.648604:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572197.672582:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572198.696487:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572199.272401:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572189/real 1788572189] req@ffff88bf476ba680 x1875453518373760/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788572199 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572199.272434:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88bf476ba680 x1875453518373760/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788572199 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572199.272459:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0513c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788572199.272481:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518373760:0@lo:39:umount.0 00000100:00080000:3.0:1788572199.272590:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788572199.272595:0:13266:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788572199.272600:0:13266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788572199.274440:0:13266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572199.274461:0:13266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572199.274468:0:13266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572199.274475:0:13266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572199.274578:0:13266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572199.274602:0:13266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572199.274608:0:13266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572199.274613:0:13266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572199.274618:0:13266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572199.276665:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572199.276679:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572199.276690:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041522800 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572199.276695:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572199.276706:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572199.276712:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572199.276717:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572199.276720:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788572199.276734:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c0503cf800 00010000:00010000:0.0:1788572199.276738:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572199.276745:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041522800/0x977d9e7969bff5b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff5bb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572199.276765:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572199.276769:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572199.276775:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c046db3000 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572199.276794:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572199.276802:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572199.276817:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572199.276822:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788572199.276824:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788572199.276829:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c0503cf800 00010000:00010000:0.0:1788572199.276832:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572199.276849:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572199.276851:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572199.276853:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572199.277278:0:13266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572199.277287:0:13266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c046db3000/0x977d9e7969bff7eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff7f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572199.277305:0:13266:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788572199.277313:0:13266:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788572199.277315:0:13266:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788572199.277354:0:13266:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788572199.277360:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788572199.277368:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572199.277374:0:13266:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788572199.277379:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff88c0760a0000) has no exports 00000020:00080000:3.0:1788572199.277407:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff88c0760a0000) has no exports 00010000:00010000:1.0:1788572199.279969:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788572199.280585:0:13266:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c0512ffde0 - data ffff88c070619e58/ffff88c07baa2c00 00000020:01000000:3.0:1788572199.280765:0:13266:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88c0514e44e0 - data ffff88c07fe2e438/ffff88bf4665f800 00100000:10000000:3.0:1788572199.295673:0:13266:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788572199.327131:0:13266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff4aa 00000020:00000080:2.0:1788572199.327157:0:13266:0:(genops.c:885:class_export_put()) final put ffff88bf45308800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788572199.327192:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf45308800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:2.0:1788572199.327219:0:13266:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c07bb14000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788572199.327227:0:13266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c07bb14000 2 00000020:01000004:2.0:1788572199.327233:0:13266:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88c07bb14000 from lustre-OST0001 00000020:00000080:2.0:1788572199.327324:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572199.327340:0:13266:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788572199.327346:0:13266:0:(genops.c:885:class_export_put()) final put ffff88bf4531e800/lustre-OST0001_UUID 00000020:00000080:2.0:1788572199.327350:0:13266:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788572199.327363:0:13266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788572199.328055:0:13266:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 07b09b9b-dc48-4957-bfb2-5dac95d9db69->MGS 00010000:00010000:2.0:1788572199.328074:0:13266:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff3c3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572199.328088:0:13266:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff3c3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572199.328095:0:13266:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788572199.328098:0:13266:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788572199.328101:0:13266:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788572199.328127:0:13266:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c0503cf800 00010000:00010000:2.0:1788572199.328131:0:13266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c040031c00/0x977d9e7969bff3bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff3c3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572199.328159:0:13266:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x977d9e7969bff601 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572199.328167:0:13266:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x977d9e7969bff601 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572199.328171:0:13266:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572199.328173:0:13266:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788572199.328175:0:13266:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788572199.328184:0:13266:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88c0503cf800 00010000:00010000:2.0:1788572199.328187:0:13266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969bff5fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x977d9e7969bff601 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572199.328204:0:13266:0:(import.c:65:import_set_state_nolock()) ffff88c0503cf800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788572199.328208:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788572199.328210:0:13266:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788572199.328212:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788572199.328217:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788572199.328230:0:13266:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88c07ba40000 x1875453518373504/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788572201 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788572199.328436:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788572199.328440:0:13266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788572199.328986:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07b09b9b-dc48-4957-bfb2-5dac95d9db69:3296:1875453518373504:0@lo:250:kworker.0 10000000:01000000:2.0:1788572199.329055:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788572199.329064:0:13266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff29d 00000020:00000080:2.0:1788572199.329070:0:13266:0:(genops.c:885:class_export_put()) final put ffff88c0503cc800/07b09b9b-dc48-4957-bfb2-5dac95d9db69 00000020:01000000:2.0:1788572199.329120:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.102@tcp (flags='') 00000020:00000080:2.0:1788572199.329126:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572199.329133:0:13266:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.102@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788572199.329154:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff88c04750cd40) has no exports 10000000:01000000:1.0:1788572199.329213:0:5827:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788572199.329352:0:13266:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.102@tcp: client import never connected 00000100:00080000:2.0:1788572199.329355:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788572199.329358:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788572199.329360:0:13266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788572199.329362:0:13266:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788572199.329607:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0503cc800/07b09b9b-dc48-4957-bfb2-5dac95d9db69 for MGC192.168.202.102@tcp 00000020:00000080:2.0:1788572199.330299:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572199.330308:0:13266:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.102@tcp (uuid 07b09b9b-dc48-4957-bfb2-5dac95d9db69) 00000020:01000000:2.0:1788572199.330314:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788572199.330318:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572199.330323:0:13266:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788572199.330328:0:13266:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff88c0513c0000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572199.330334:0:13266:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff88c048548000) has exports, disconnecting them 00000020:00080000:2.0:1788572199.330339:0:13266:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff88c0513c0000), last request at 1788571967 00000020:00000080:2.0:1788572199.330343:0:13266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff4d4 00000020:00080000:2.0:1788572199.330356:0:13266:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88c0513c0000): rc 0 00000020:00000080:2.0:1788572199.330360:0:13266:0:(genops.c:885:class_export_put()) final put ffff88c0513c0000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788572199.330648:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c0503cf800 for MGC192.168.202.102@tcp 00000020:00000080:0.0:1788572199.330656:0:36:0:(genops.c:885:class_export_put()) final put ffff88c0503ce000/07b09b9b-dc48-4957-bfb2-5dac95d9db69 00000020:00000080:0.0:1788572199.330658:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0503ce000/07b09b9b-dc48-4957-bfb2-5dac95d9db69 for MGC192.168.202.102@tcp 00000020:01000000:0.0:1788572199.330664:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.102@tcp (07b09b9b-dc48-4957-bfb2-5dac95d9db69) 00000020:00000080:0.0:1788572199.332989:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c0513c0000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788572199.384335:0:13266:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788572199.384346:0:13266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788572199.384352:0:13266:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788572199.384360:0:13266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788572199.384649:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788572199.384785:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88c0513c7800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788572199.384822:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788572199.384912:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788572199.385006:0:5813:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff88c049affa00:5813] 0 exiting: rc = 1 00000100:00100000:3.0:1788572199.386181:0:8504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff88bf45113400:8504] 2 exiting: rc = 0 00000100:00100000:3.0:1788572199.386320:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff88c05991e600:5814] 1 exiting: rc = 0 00000100:00100000:1.0:1788572199.387106:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572199.389864:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff88c058f89400:5817] 2 exiting: rc = 0 00000100:00100000:0.0:1788572199.390426:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff88c05991f800:5815] 0 exiting: rc = 1 00000100:00100000:0.0:1788572199.390628:0:11167:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff88c048572e00:11167] 3 exiting: rc = 0 00000100:00100000:2.0:1788572199.394492:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff88c059239600:5816] 1 exiting: rc = 0 00000100:00100000:1.0:1788572199.395057:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395067:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395075:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395083:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395092:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395100:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395109:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395118:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395127:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395136:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395157:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395164:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395171:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395176:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395182:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395187:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395193:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395198:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395203:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395209:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395214:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395219:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395225:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395243:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395280:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395286:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395292:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395301:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395309:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395324:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395333:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395340:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395348:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395357:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395367:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395393:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395399:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395408:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395416:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395426:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395434:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395442:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395449:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395474:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395482:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395492:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395500:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395509:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395516:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395526:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395535:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395544:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395552:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395561:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395569:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395579:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395589:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395597:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395622:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395631:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395639:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395649:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395658:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.395668:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788572199.397782:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572199.397796:0:13266:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788572199.397802:0:13266:0:(genops.c:885:class_export_put()) final put ffff88bf4531f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788572199.397807:0:13266:0:(genops.c:844:class_export_destroy()) destroying export ffff88bf4531f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788572199.397814:0:13266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788572199.397872:0:13266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c07bb14000 1 00000020:00000080:1.0:1788572199.397879:0:13266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x977d9e7969bff479 00000020:00000080:1.0:1788572199.397885:0:13266:0:(genops.c:885:class_export_put()) final put ffff88c058aae000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788572199.398612:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788572199.398623:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572199.398632:0:13266:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572199.398637:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff88c04854b380) has no exports 00000020:00000080:0.0:1788572199.399308:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88c058aae000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788572199.439694:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572199.439715:0:13266:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788572199.439725:0:13266:0:(genops.c:885:class_export_put()) final put ffff88c07bb12000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788572199.439732:0:13266:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07bb12000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788572199.439748:0:13266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788572199.443440:0:13266:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88c07bb11800 00000020:01000000:1.0:1788572199.443575:0:13266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788572199.443584:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572199.443588:0:13266:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788572199.443593:0:13266:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff88c076484d40) has no exports 00000020:00000080:1.0:1788572199.443619:0:13266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572199.443629:0:13266:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788572199.443633:0:13266:0:(genops.c:885:class_export_put()) final put ffff88c07bd4a000/OSS_uuid 00000020:00000080:1.0:1788572199.443637:0:13266:0:(genops.c:844:class_export_destroy()) destroying export ffff88c07bd4a000/OSS_uuid for OSS 00000020:01000000:1.0:1788572199.443642:0:13266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788572199.443749:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff88c076322800:6681] 2 exiting: rc = 0 00000100:00100000:1.0:1788572199.443836:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff88c058bf3600:6679] 0 exiting: rc = 1 00000100:00080000:0.0:1788572199.444180:0:5826:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788572199.444408:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff88c07bc54200:6680] 1 exiting: rc = 0 00000100:00100000:0.0:1788572199.444788:0:11678:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff88c048528600:11678] 3 exiting: rc = 0 00000100:00100000:1.0:1788572199.444911:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444922:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444934:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444941:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444946:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444950:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444956:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444960:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444967:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444972:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444977:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444982:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444987:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444991:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.444996:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445001:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445007:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445011:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445017:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445022:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445028:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445034:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445038:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445043:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445048:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445053:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445059:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445064:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445070:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445075:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445080:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445085:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445091:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445108:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445113:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445119:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445127:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445134:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445149:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445156:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445161:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445167:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445174:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445179:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445185:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445190:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445197:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445203:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445209:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445213:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445218:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445223:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445229:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445236:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445243:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445462:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445471:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445476:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445481:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445486:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445491:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445496:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445500:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.445506:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.446877:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff88c076323200:6683] 1 exiting: rc = 0 00000100:00100000:0.0:1788572199.447103:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff88c076323400:6682] 0 exiting: rc = 1 00000100:00100000:1.0:1788572199.447202:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447210:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447215:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447234:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447239:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447244:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447368:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447383:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447388:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447393:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447399:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447403:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447408:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447413:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447418:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447422:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447427:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447432:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447437:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447442:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447447:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447451:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447574:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447580:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447584:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447589:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447594:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447599:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447603:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447607:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447612:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447618:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447624:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447629:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447633:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447638:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447643:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447648:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447659:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447665:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447669:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447674:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447678:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447683:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447687:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447692:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447696:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447702:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447706:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447711:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447716:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447721:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447726:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447730:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447734:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447738:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447743:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447748:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447753:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447757:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447762:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447766:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447770:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.447776:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572199.449438:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff88c076c18200:6684] 0 exiting: rc = 1 00000100:00100000:0.0:1788572199.449635:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff88c076468a00:6685] 1 exiting: rc = 0 00000100:00100000:0.0:1788572199.449778:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff88c076469e00:6686] 2 exiting: rc = 0 00000100:00100000:1.0:1788572199.450127:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450135:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450149:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450155:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450160:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450165:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450179:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450186:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450192:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450208:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450214:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450219:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450224:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450230:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450236:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450242:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450277:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450284:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450289:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450294:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450300:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450306:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450311:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450327:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450334:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450339:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450344:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450349:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450355:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450360:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450512:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450520:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450525:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450530:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450535:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450541:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450545:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450550:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450556:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450561:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450567:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450572:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450577:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450582:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450595:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450601:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450606:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450626:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450632:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450637:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450642:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450648:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450653:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450659:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450664:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450673:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450678:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450682:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450687:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450692:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450698:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450703:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450707:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.450712:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.459616:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff88c076330000:6688] 1 exiting: rc = 0 00000100:00100000:0.0:1788572199.459737:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff88c07bbb7600:6687] 0 exiting: rc = 1 00000100:00100000:1.0:1788572199.460188:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460196:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460201:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460206:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460212:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460218:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460223:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460228:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460234:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460239:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460245:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460392:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460413:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460419:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460435:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460440:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460444:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460449:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460584:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460589:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460593:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460598:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460602:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460607:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460611:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460617:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460623:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460629:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460634:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460639:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460644:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460649:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460653:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460659:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460664:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460669:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460675:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460680:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460685:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460690:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460695:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460700:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460704:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460709:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460714:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460719:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460725:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460730:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460734:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460746:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460751:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460755:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460760:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460765:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460770:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460775:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460780:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460784:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460789:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460795:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460800:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460804:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460810:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.460816:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788572199.462718:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff88c0768dcc00:6689] 0 exiting: rc = 1 00000100:00100000:3.0:1788572199.463067:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff88c0768dc400:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1788572199.463386:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463400:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463427:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463438:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463447:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463752:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463763:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463774:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463787:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463796:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463802:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463808:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463814:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463819:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463839:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463847:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463853:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463859:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463866:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463872:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463887:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463893:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463911:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463917:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463922:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463927:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463947:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463954:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463960:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463966:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463972:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463977:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463982:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463988:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463993:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.463999:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464006:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464012:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464033:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464041:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464047:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464052:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464058:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464064:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464070:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464075:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464081:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464086:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464092:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464098:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464118:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464125:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464131:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464137:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464151:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464163:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464169:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464174:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464180:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464186:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464192:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464198:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464205:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788572199.464220:0:13266:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788572199.478550:0:13266:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788572216.172759:0:13883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788572226.098955:0:14343:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788572226.099089:0:14343:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788572226.099413:0:14343:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88bf452dd800 00000020:01000004:3.0:1788572226.099433:0:14343:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788572226.099441:0:14343:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788572226.099455:0:14343:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff88c076483380) 00000020:00000080:3.0:1788572226.099469:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788572226.122692:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788572226.132218:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788572226.133156:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788572226.133231:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 447: rc = 0 00100000:10000000:2.0:1788572226.133589:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 447: rc = 0 00100000:10000000:2.0:1788572226.133712:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 447: rc = 0 00100000:10000000:2.0:1788572226.135659:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 447: rc = 0 00100000:10000000:2.0:1788572226.135853:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 447: rc = 0 00100000:10000000:2.0:1788572226.136564:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 447: rc = 0 00100000:10000000:2.0:1788572226.136954:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 449: rc = 0 00100000:10000000:2.0:1788572226.139976:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 642: rc = 0 00100000:10000000:2.0:1788572226.140168:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 642: rc = 0 00100000:10000000:2.0:1788572226.140912:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 158: rc = 0 00100000:10000000:2.0:1788572226.141467:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 158: rc = 0 00100000:10000000:2.0:1788572226.141723:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 158: rc = 0 00100000:10000000:2.0:1788572226.142167:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 158: rc = 0 00100000:10000000:2.0:1788572226.142552:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 158: rc = 0 00100000:10000000:2.0:1788572226.142808:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 158: rc = 0 00100000:10000000:2.0:1788572226.143029:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 158: rc = 0 00100000:10000000:2.0:1788572226.143242:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 158: rc = 0 00100000:10000000:2.0:1788572226.143881:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 158: rc = 0 00100000:10000000:2.0:1788572226.144445:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 158: rc = 0 00100000:10000000:2.0:1788572226.144711:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 158: rc = 0 00100000:10000000:2.0:1788572226.145206:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 158: rc = 0 00100000:10000000:2.0:1788572226.146221:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 591: rc = 0 00100000:10000000:2.0:1788572226.146850:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 591: rc = 0 00100000:10000000:2.0:1788572226.147663:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 591: rc = 0 00100000:10000000:2.0:1788572226.148383:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 591: rc = 0 00100000:10000000:2.0:1788572226.148635:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 591: rc = 0 00100000:10000000:2.0:1788572226.149623:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 591: rc = 0 00100000:10000000:2.0:1788572226.149912:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 591: rc = 0 00100000:10000000:2.0:1788572226.150539:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 591: rc = 0 00100000:10000000:2.0:1788572226.151166:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 591: rc = 0 00100000:10000000:2.0:1788572226.151898:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 591: rc = 0 00100000:10000000:2.0:1788572226.152520:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 591: rc = 0 00100000:10000000:2.0:1788572226.152941:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 591: rc = 0 00100000:10000000:2.0:1788572226.153685:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 591: rc = 0 00100000:10000000:2.0:1788572226.154904:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 591: rc = 0 00100000:10000000:2.0:1788572226.155201:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 591: rc = 0 00100000:10000000:2.0:1788572226.155494:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 591: rc = 0 00100000:10000000:2.0:1788572226.155725:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 591: rc = 0 00100000:10000000:2.0:1788572226.155995:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 591: rc = 0 00100000:10000000:2.0:1788572226.156239:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 591: rc = 0 00100000:10000000:2.0:1788572226.156526:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 591: rc = 0 00100000:10000000:2.0:1788572226.156792:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 591: rc = 0 00100000:10000000:2.0:1788572226.157073:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 591: rc = 0 00100000:10000000:2.0:1788572226.157381:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 591: rc = 0 00100000:10000000:2.0:1788572226.157698:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 591: rc = 0 00100000:10000000:2.0:1788572226.160558:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 591: rc = 0 00100000:10000000:2.0:1788572226.162592:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 591: rc = 0 00100000:10000000:3.0:1788572226.175531:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 591: rc = 0 00100000:10000000:3.0:1788572226.175858:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 591: rc = 0 00100000:10000000:3.0:1788572226.176359:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 591: rc = 0 00100000:10000000:3.0:1788572226.176589:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 591: rc = 0 00100000:10000000:3.0:1788572226.177206:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 591: rc = 0 00100000:10000000:3.0:1788572226.177540:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 591: rc = 0 00100000:10000000:3.0:1788572226.178542:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 172: rc = 0 00100000:10000000:3.0:1788572226.183437:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788572226.183746:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 125: rc = 0 00100000:10000000:3.0:1788572226.184443:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788572226.184524:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 125: rc = 0 00100000:10000000:3.0:1788572226.185229:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788572226.185331:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 125: rc = 0 00100000:10000000:3.0:1788572226.189491:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788572226.190226:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:3.0:1788572226.190540:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788572226.190611:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:3.0:1788572226.194404:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788572226.194512:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00000020:00000080:3.0:1788572226.194836:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788572226.194846:0:14343:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788572226.194858:0:14343:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c0059e 00000020:01000004:3.0:1788572226.194868:0:14343:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788572226.194874:0:14343:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788572226.194879:0:14343:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88bf452dd800 from MGS 00000020:01000004:3.0:1788572226.194883:0:14343:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788572226.194892:0:14343:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff88c076480000) 00000020:00000080:3.0:1788572226.194902:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788572226.199965:0:14343:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf452dd800 from MGS, refs=2 00080000:01000000:2.0:1788572226.200047:0:14343:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788572226.200068:0:14343:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c005ac 00000100:00100000:2.0:1788572226.200355:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788572226.200491:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788572226.200498:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788572226.209416:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788572226.209437:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788572226.214042:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572226.214627:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788572226.214636:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788572226.220200:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788572226.220283:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788572226.221459:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788572226.221469:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788572226.222303:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.222306:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.222308:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.222710:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.222713:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572226.222715:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.224700:0:14343:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788572226.226478:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788572226.237242:0:14343:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788572226.237285:0:14343:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788572226.237288:0:14343:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788572226.240262:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788572226.240448:0:14343:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788572226.240552:0:14343:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788572226.241494:0:14343:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788572226.241831:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788572226.242011:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788572226.242018:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788572226.244634:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788572226.244646:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788572226.246881:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788572226.246894:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788572226.259973:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788572226.260009:0:14343:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.102@tcp' 00000020:01000004:3.0:1788572226.260011:0:14343:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788572226.260044:0:14343:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.102@tcp (typ=mgc) 00000020:00000080:3.0:1788572226.260061:0:14343:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.102@tcp (ffff88c076484d40) 00000020:00000080:3.0:1788572226.260077:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788572226.260162:0:14343:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c0503cc800@MGC192.168.202.102@tcp: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1788572226.262136:0:14343:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.102@tcp-0 is initialized 00000040:01000000:3.0:1788572226.262147:0:14343:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788572226.262768:0:14357:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788572226.265497:0:14358:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788572226.271448:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.102@tcp (uuid bf634c0e-dd8a-4982-ad2a-0f984621b961) 00000020:00000080:3.0:1788572226.271484:0:14343:0:(genops.c:1385:class_connect()) connect: client bf634c0e-dd8a-4982-ad2a-0f984621b961, cookie 0x977d9e7969c005ba 00000100:00080000:3.0:1788572226.271498:0:14343:0:(import.c:545:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572226.271505:0:14343:0:(import.c:665:import_select_connection()) MGC192.168.202.102@tcp: import ffff88c0503cc800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572226.271560:0:14343:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bf476b9f80 x1875453518373888/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572226.271592:0:14343:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bf634c0e-dd8a-4982-ad2a-0f984621b961->MGS 00000020:01000004:3.0:1788572226.271614:0:14343:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788572226.271621:0:14343:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788572226.271638:0:14343:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff88c0764819c0) 00000020:00000080:3.0:1788572226.271652:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788572226.273511:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf634c0e-dd8a-4982-ad2a-0f984621b961:3296:1875453518373888:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788572226.273615:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572226.274451:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518373888 00000100:00100000:2.0:1788572226.274461:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518373888 00000100:00100000:2.0:1788572226.274497:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572226.274505:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3296:x1875453518373888:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788572226.274538:0:14353:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bf634c0e-dd8a-4982-ad2a-0f984621b961@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1788572226.274571:0:14353:0:(genops.c:1385:class_connect()) connect: client bf634c0e-dd8a-4982-ad2a-0f984621b961, cookie 0x977d9e7969c005c8 00000100:00080000:2.0:1788572226.274712:0:14353:0:(import.c:65:import_set_state_nolock()) ffff88c074cb9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572226.274808:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+5:3296:x1875453518373888:12345-0@lo:250:mount.lustre.0 Request processed in 300us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572226.274815:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572226.276277:0:3296:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788572226.276290:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.102@tcp: connect to target with instance 0 00000100:00080000:1.0:1788572226.276299:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788572226.276305:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788572226.276309:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0503cc800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788572226.276313:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788572226.276325:0:3296:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788572226.277098:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf634c0e-dd8a-4982-ad2a-0f984621b961:3296:1875453518373888:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788572226.304880:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788572226.305091:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788572226.305099:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788572226.306913:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788572226.306930:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788572226.307630:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788572226.307641:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788572226.310485:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788572226.310686:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788572226.310693:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788572226.312114:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788572226.312125:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788572226.377148:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788572226.377632:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788572226.377640:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788572226.380430:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788572226.380442:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788572226.381447:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788572226.381899:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788572226.381906:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788572226.382527:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788572226.382537:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788572226.383652:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572226.383861:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788572226.383867:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788572226.385151:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788572226.385166:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788572226.385942:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572226.386115:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788572226.386121:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788572226.386987:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788572226.386996:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788572226.421162:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788572226.421421:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788572226.421429:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788572226.429089:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788572226.429106:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788572226.439982:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788572226.439999:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788572226.441941:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788572226.441971:0:14343:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788572226.441979:0:14343:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788572226.442147:0:14343:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788572226.442185:0:14343:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788572226.442190:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788572226.442191:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572226.442193:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572226.442198:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572226.442200:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572226.442201:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572226.442202:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572226.442203:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572226.442205:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572226.442206:0:14343:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788572226.442209:0:14343:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788572226.442211:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572226.442212:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572226.442213:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572226.442214:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572226.442215:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572226.442216:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572226.442216:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572226.442217:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572226.442218:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572226.442219:0:14343:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788572226.442297:0:14343:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788572226.442322:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572226.442712:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572226.442777:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07610df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.442985:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518374016 00000100:00100000:3.0:1788572226.442995:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518374016 00000100:00100000:3.0:1788572226.443055:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572226.443066:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+5:14343:x1875453518374016:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788572226.443115:0:14356:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788572226.443118:0:14356:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788572226.443121:0:14356:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788572226.443924:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788572226.444586:0:14356:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788572226.456933:0:14378:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788572226.456945:0:14378:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788572226.456948:0:14378:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788572226.456984:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788572226.459582:0:14356:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788572226.459595:0:14356:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788572226.468948:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+5:14343:x1875453518374016:12345-0@lo:253:mount.lustre.0 Request processed in 25870us (26224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.468964:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788572226.469086:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374016:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572226.469103:0:14343:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788572226.469106:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572226.469108:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788572226.469110:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572226.469111:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572226.469112:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572226.469114:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572226.469115:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572226.469117:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788572226.469120:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572226.469121:0:14343:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788572226.469165:0:14343:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88bf452dd800 from lustre-MDT0000 10000000:01000000:0.0:1788572226.469196:0:14343:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788572226.469199:0:14343:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788572226.469203:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88c076484d40 10000000:01000000:0.0:1788572226.469207:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572226.469216:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88c076484d40 from 1 10000000:01000000:0.0:1788572226.469220:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788572226.469296:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.469308:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.469318:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572226.469555:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572226.469606:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572226.469702:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050342180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.473770:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518374144 00000100:00100000:3.0:1788572226.473788:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518374144 00000100:00100000:3.0:1788572226.473880:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788572226.473892:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+5:14343:x1875453518374144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572226.473913:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572226.473940:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387200/0x977d9e7969c005d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c005cf expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.473970:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387200/0x977d9e7969c005d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c005cf expref: 6 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.473982:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387200/0x977d9e7969c005d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c005cf expref: 6 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.473992:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387200, rc 0) 00000100:00100000:3.0:1788572226.474084:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+6:14343:x1875453518374144:12345-0@lo:101:mount.lustre.0 Request processed in 194us (4477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.474092:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788572226.474360:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572226.474380:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.474391:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572226.474462:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572226.474500:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.474534:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050313b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572226.474661:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518374272 00000100:00100000:2.0:1788572226.474666:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518374272 00000100:00100000:2.0:1788572226.474708:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788572226.474715:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+6:14343:x1875453518374272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572226.474977:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+6:14343:x1875453518374272:12345-0@lo:501:mount.lustre.0 Request processed in 262us (476us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572226.474985:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788572226.476172:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374272:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788572226.476210:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788572226.476223:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.476234:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572226.476244:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88bf452dd800 10000000:01000000:1.0:1788572226.476301:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788572226.476307:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88bf452dd800 10000000:01000000:1.0:1788572226.476310:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788572226.476313:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88bf452dd800 from 1 10000000:01000000:1.0:1788572226.476316:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788572226.476361:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994800/0x977d9e7969c005dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.476369:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076994800/0x977d9e7969c005dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.476380:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076994800/0x977d9e7969c005dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572226.476397:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572226.476446:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.476481:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050313b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.477708:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518374400 00000100:00100000:3.0:1788572226.477722:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518374400 00000100:00100000:3.0:1788572226.477809:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572226.477819:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+6:14343:x1875453518374400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572226.477833:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572226.477851:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387400/0x977d9e7969c005e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c005dd expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.477876:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387400/0x977d9e7969c005e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c005dd expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.477886:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387400/0x977d9e7969c005e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c005dd expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.477912:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387400, rc 0) 00000100:00100000:3.0:1788572226.477982:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+7:14343:x1875453518374400:12345-0@lo:101:mount.lustre.0 Request processed in 164us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.477988:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572226.479017:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572226.479054:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076994800/0x977d9e7969c005dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005e4 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.479067:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076994800/0x977d9e7969c005dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c005e4 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572226.479085:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788572226.479104:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994800/0x977d9e7969c005dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005e4 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.479112:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076994800/0x977d9e7969c005dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005e4 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572226.479132:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788572226.479136:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788572226.479143:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88bf452dd800 10000000:01000000:1.0:1788572226.479145:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788572226.479149:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788572226.479151:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788572226.479182:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c005eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.479191:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c005eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.479199:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c005eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572226.479221:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572226.479323:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.479572:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050313b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.479660:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518374528 00000100:00100000:3.0:1788572226.479666:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518374528 00000100:00100000:3.0:1788572226.479712:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572226.479721:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+7:14343:x1875453518374528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572226.479745:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572226.479761:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387600/0x977d9e7969c005f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c005eb expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.479781:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387600/0x977d9e7969c005f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c005eb expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.479791:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387600/0x977d9e7969c005f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c005eb expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.479799:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387600, rc 0) 00000100:00100000:3.0:1788572226.479846:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+8:14343:x1875453518374528:12345-0@lo:101:mount.lustre.0 Request processed in 126us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.479853:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788572226.480031:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572226.480055:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c005eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005f2 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.480063:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c005eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c005f2 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572226.480114:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572226.480143:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.480213:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050313b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572226.488833:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518374656 00000100:00100000:0.0:1788572226.488850:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518374656 00000100:00100000:0.0:1788572226.488930:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788572226.488942:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c413850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+8:14343:x1875453518374656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572226.489756:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c413850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+9:14343:x1875453518374656:12345-0@lo:501:mount.lustre.0 Request processed in 812us (9608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572226.489768:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572226.493825:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572226.494149:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572226.494241:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.494463:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050313b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572226.494971:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518374784 00000100:00100000:2.0:1788572226.494981:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518374784 00000100:00100000:2.0:1788572226.495040:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788572226.495052:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+9:14343:x1875453518374784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572226.495782:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+9:14343:x1875453518374784:12345-0@lo:503:mount.lustre.0 Request processed in 730us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572226.495791:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788572226.495902:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518374784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572226.496681:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14379:1875453518374912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572226.496747:0:14379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.496840:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050313e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572226.504929:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518374912 00000100:00100000:0.0:1788572226.504949:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518374912 00000100:00100000:2.0:1788572226.508316:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788572226.508333:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+9:14379:x1875453518374912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572226.508774:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+9:14379:x1875453518374912:12345-0@lo:502:llog_process_th.0 Request processed in 444us (12026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572226.508784:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788572226.509000:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14379:1875453518374912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572226.509051:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572226.509063:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.509065:0:14379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788572226.509073:0:14379:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788572226.509083:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572226.509105:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff88c0766fb380) 00000020:00000080:3.0:1788572226.509126:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788572226.509135:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788572226.509217:0:14379:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788572226.509225:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c00600 00000020:00000080:3.0:1788572226.509466:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788572226.509470:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572226.509474:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.509475:0:14379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788572226.509478:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572226.509482:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.509483:0:14379:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788572226.509486:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572226.509493:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff88c0766f8000) 00000020:00000080:3.0:1788572226.509502:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788572226.509506:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788572226.509508:0:14379:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788572226.509511:0:14379:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788572226.509517:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788572226.509558:0:14379:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf452dd800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788572226.509570:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff88c0766f99c0) 00000020:00000080:3.0:1788572226.509578:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788572226.509632:0:14379:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788572226.509638:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c00615 00000020:00000080:3.0:1788572226.509754:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788572226.509760:0:14379:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788572226.509765:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x977d9e7969c0061c 00080000:01000000:3.0:1788572226.509770:0:14379:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788572226.509774:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c00623 00010000:00010000:1.0:1788572226.615658:0:14379:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788572226.616117:0:14379:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788572226.616874:0:14379:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788572226.617704:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff88c04854b380) 00000020:00000080:1.0:1788572226.617734:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788572226.617800:0:14379:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788572226.617808:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c00631 00000020:00000080:3.0:1788572226.619961:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788572226.631370:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x977d9e7969c00638 00000020:00000080:3.0:1788572226.632218:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788572226.632235:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572226.632241:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.632432:0:14379:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788572226.632437:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572226.632441:0:14379:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788572226.632443:0:14379:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572226.632444:0:14379:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572226.632446:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572226.632450:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.632451:0:14379:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572226.632454:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572226.632460:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.632461:0:14379:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788572226.632466:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788572226.632506:0:14379:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788572226.632523:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572226.632526:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.632527:0:14379:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788572226.632530:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788572226.632534:0:14379:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788572226.632537:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.632538:0:14379:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788572226.632541:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572226.632546:0:14379:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:3.0:1788572226.632573:0:14379:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788572226.632576:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572226.632591:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88c0766fcd40) 00000020:00000080:3.0:1788572226.632606:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788572226.632610:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572226.632655:0:14379:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788572226.632660:0:14379:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788572226.632665:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c00646 00010000:00080000:3.0:1788572226.632692:0:14379:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c0503cd800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1788572226.632933:0:14379:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788572226.633321:0:14379:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788572226.635165:0:14379:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788572226.642090:0:14379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572226.642162:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788572226.642838:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788572226.644026:0:14383:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788572226.644035:0:14383:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788572226.644765:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572226.644777:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788572226.644813:0:14379:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788572226.644832:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c0064d 00000100:00080000:2.0:1788572226.644845:0:14379:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788572226.644851:0:14379:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88c0503cd800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788572226.644894:0:14379:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c0502ad880 x1875453518375040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572226.644914:0:14379:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788572226.645065:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518375040:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788572226.645145:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875453518375040 offset 0 length 520: 4 00000020:01000000:2.0:1788572226.645299:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572226.645304:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572226.645306:0:14379:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788572226.645309:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788572226.645312:0:14379:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788572226.645314:0:14379:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572226.645315:0:14379:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788572226.645317:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788572226.645320:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572226.645321:0:14379:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788572226.645324:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788572226.645336:0:14379:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788572226.645351:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572226.645353:0:14379:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788572226.645356:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788572226.645360:0:14379:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:2.0:1788572226.645385:0:14379:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788572226.645389:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788572226.645402:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88c0760a0000) 00000020:00000080:2.0:1788572226.645416:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788572226.645420:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788572226.645484:0:14379:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788572226.645491:0:14379:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788572226.645498:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x977d9e7969c0065b 00010000:00080000:2.0:1788572226.645531:0:14379:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c0556c2000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1788572226.645759:0:14379:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788572226.645951:0:14379:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788572226.645977:0:14379:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788572226.646572:0:14379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572226.646637:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788572226.646708:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788572226.647234:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788572226.647240:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788572226.647877:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572226.647888:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788572226.647917:0:14379:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788572226.647938:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c00662 00000100:00080000:3.0:1788572226.647950:0:14379:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572226.647958:0:14379:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88c0556c2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572226.648002:0:14379:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bf476bb100 x1875453518375168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572226.648031:0:14379:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788572226.648101:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572226.648105:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.648107:0:14379:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788572226.648111:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572226.648115:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.648116:0:14379:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788572226.648118:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788572226.648121:0:14379:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788572226.648123:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572226.648125:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.648126:0:14379:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788572226.648129:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572226.648139:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.648141:0:14379:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788572226.648144:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788572226.648181:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14379:1875453518375296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572226.648309:0:14379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572226.648431:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0515983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572226.648495:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518375168:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788572226.648525:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875453518375168 offset 0 length 520: 4 00000100:00100000:2.0:1788572226.652604:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518375296 00000100:00100000:2.0:1788572226.652622:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518375296 00000100:00100000:2.0:1788572226.652707:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572226.652729:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+9:14379:x1875453518375296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572226.654659:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+9:14379:x1875453518375296:12345-0@lo:502:llog_process_th.0 Request processed in 1931us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572226.654673:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788572226.657585:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14379:1875453518375296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788572226.657648:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572226.657659:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572226.657662:0:14379:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788572226.657668:0:14379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788572226.664650:0:14343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788572226.664691:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788572226.664828:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c005eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005f2 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.664861:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076995c00/0x977d9e7969c005eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005f2 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572226.664943:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88bf452dd800 from 1 10000000:01000000:3.0:1788572226.664947:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572226.665000:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.665008:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.665019:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572226.665044:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572226.665115:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572226.665155:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788572226.665218:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518375424 00000100:00100000:1.0:1788572226.665226:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518375424 00000100:00100000:1.0:1788572226.665301:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788572226.665310:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c413c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+9:14343:x1875453518375424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572226.665322:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572226.665337:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c00669 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.665367:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c00669 expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.665378:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00669 expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.665386:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995200, rc 0) 00000100:00100000:1.0:1788572226.665424:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c413c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+10:14343:x1875453518375424:12345-0@lo:101:mount.lustre.0 Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572226.665430:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788572226.665668:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572226.665681:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.665690:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572226.666178:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375552:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788572226.666225:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572226.666288:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0512bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.666353:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518375552 00000100:00100000:3.0:1788572226.666359:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518375552 00000100:00100000:3.0:1788572226.666390:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788572226.666397:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c412c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+10:14343:x1875453518375552:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788572226.666415:0:14353:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788572226.666421:0:14353:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788572226.666482:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c412c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+10:14343:x1875453518375552:12345-0@lo:256:mount.lustre.0 Request processed in 85us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.666489:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788572226.666687:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375552:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788572226.667221:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572226.667732:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.667744:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572226.667806:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf452dd800 from 1 10000000:01000000:3.0:1788572226.667810:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572226.667851:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.667858:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.667868:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572226.667888:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572226.667943:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572226.667980:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572226.668028:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518375680 00000100:00100000:2.0:1788572226.668034:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518375680 00000100:00100000:2.0:1788572226.668073:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572226.668080:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+10:14343:x1875453518375680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572226.668090:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572226.668163:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c00677 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.668187:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c00677 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.668198:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00677 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572226.668206:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d600, rc 0) 00000100:00100000:2.0:1788572226.668283:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14343:x1875453518375680:12345-0@lo:101:mount.lustre.0 Request processed in 202us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572226.668289:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788572226.668622:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572226.668635:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.668644:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572226.668697:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572226.668735:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.668763:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.668818:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518375808 00000100:00100000:3.0:1788572226.668823:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518375808 00000100:00100000:3.0:1788572226.668858:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788572226.668866:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c410c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14343:x1875453518375808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572226.669522:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c410c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14343:x1875453518375808:12345-0@lo:501:mount.lustre.0 Request processed in 654us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.669529:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788572226.669639:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572226.669671:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572226.669708:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.669739:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.669838:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518375936 00000100:00100000:3.0:1788572226.669842:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518375936 00000100:00100000:3.0:1788572226.669873:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788572226.669880:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14343:x1875453518375936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572226.670108:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14343:x1875453518375936:12345-0@lo:503:mount.lustre.0 Request processed in 228us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.670114:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572226.670907:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518375936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572226.671960:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14387:1875453518376064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572226.672035:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.672121:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572226.672162:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518376064 00000100:00100000:2.0:1788572226.672169:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518376064 00000100:00100000:2.0:1788572226.672238:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788572226.672466:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14387:x1875453518376064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572226.672746:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14387:x1875453518376064:12345-0@lo:502:llog_process_th.0 Request processed in 283us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572226.672754:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788572226.672839:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14387:1875453518376064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572226.672865:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572226.672877:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.672879:0:14387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788572226.672887:0:14387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bf452dd800 00000020:00000080:3.0:1788572226.672890:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788572226.672899:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572226.672901:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.672903:0:14387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788572226.672905:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572226.672907:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.672909:0:14387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788572226.672912:0:14387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bf452dd800 00000020:00000080:3.0:1788572226.672914:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788572226.672977:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572226.672980:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.672982:0:14387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788572226.672984:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572226.672986:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572226.672988:0:14387:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788572226.672991:0:14387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88bf452dd800 00000020:00000080:3.0:1788572226.672993:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788572226.673031:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14387:1875453518376192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572226.673071:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.681571:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518376192 00000100:00100000:1.0:1788572226.681589:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518376192 00000100:00100000:1.0:1788572226.681669:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788572226.681680:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14387:x1875453518376192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572226.681956:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14387:x1875453518376192:12345-0@lo:502:llog_process_th.0 Request processed in 277us (8884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572226.681965:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788572226.688837:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0515986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572226.688883:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14387:1875453518376192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572226.688930:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572226.688938:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572226.688941:0:14387:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788572226.688947:0:14387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788572226.697653:0:14343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788572226.697757:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572226.697827:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.697860:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572226.697945:0:14343:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788572226.697948:0:14343:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88bf452dd800 10000000:01000000:3.0:1788572226.697952:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88bf452dd800 10000000:01000000:3.0:1788572226.697957:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788572226.697964:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88bf452dd800 from 1 10000000:01000000:3.0:1788572226.697966:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572226.698027:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386e00/0x977d9e7969c00685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.698060:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041386e00/0x977d9e7969c00685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.698090:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041386e00/0x977d9e7969c00685 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572226.698161:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518376320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572226.698326:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.698474:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518376320 00000100:00100000:1.0:1788572226.698483:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518376320 00000100:00100000:1.0:1788572226.698547:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788572226.698558:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14343:x1875453518376320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572226.698575:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572226.698593:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076994200/0x977d9e7969c0068c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c00685 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.698624:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076994200/0x977d9e7969c0068c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c00685 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.698639:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076994200/0x977d9e7969c0068c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00685 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.698664:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994200, rc 0) 00000100:00100000:1.0:1788572226.698708:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14343:x1875453518376320:12345-0@lo:101:mount.lustre.0 Request processed in 152us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572226.698715:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788572226.699619:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.699677:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518376320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572226.699712:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041386e00/0x977d9e7969c00685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0068c expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.699736:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041386e00/0x977d9e7969c00685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c0068c expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572226.699886:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518376448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572226.699947:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572226.699978:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.700007:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518376448 00000100:00100000:3.0:1788572226.700012:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518376448 00000100:00100000:3.0:1788572226.700052:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788572226.700061:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14343:x1875453518376448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572226.700433:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14343:x1875453518376448:12345-0@lo:501:mount.lustre.0 Request processed in 371us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.700440:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788572226.700482:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518376448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572226.700510:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518376576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572226.700549:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572226.700562:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.700574:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518376576 00000100:00100000:3.0:1788572226.700577:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518376576 00000100:00100000:3.0:1788572226.700599:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788572226.700605:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14343:x1875453518376576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572226.700753:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14343:x1875453518376576:12345-0@lo:503:mount.lustre.0 Request processed in 147us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.700759:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788572226.700807:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518376576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572226.703071:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14392:1875453518376704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572226.703161:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572226.703204:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0512bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.703457:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518376704 00000100:00100000:3.0:1788572226.703466:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518376704 00000100:00100000:3.0:1788572226.703511:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788572226.703521:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14392:x1875453518376704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572226.703796:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14392:x1875453518376704:12345-0@lo:502:llog_process_th.0 Request processed in 275us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.703810:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788572226.703869:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14392:1875453518376704:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788572226.703929:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788572226.703949:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff88c04a5f0000) 00000020:00000080:3.0:1788572226.703970:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788572226.704037:0:14392:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf452dd800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788572226.704041:0:14392:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bf452dd800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788572226.704044:0:14392:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bf452dd800 4 00010000:00080000:3.0:1788572226.704072:0:14392:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c065ad0800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1788572226.709080:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788572226.709296:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788572226.709331:0:14392:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788572226.709348:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x977d9e7969c0069a 00000100:00080000:3.0:1788572226.709360:0:14392:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572226.709366:0:14392:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88c065ad0800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572226.709405:0:14392:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bf476bbb80 x1875453518376832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572226.709457:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518376832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572226.709547:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572226.709595:0:14392:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788572226.711087:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518376832 00000100:00100000:1.0:1788572226.711101:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518376832 00000100:00100000:1.0:1788572226.711148:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572226.711158:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1875453518376832:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572226.711269:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1875453518376832:12345-0@lo:38:llog_process_th.0 Request processed in 90us (1700us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788572226.711277:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788572226.720309:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572226.720322:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c065ad0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572226.720329:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572226.720333:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518376832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572226.720488:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14392:1875453518376960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572226.720574:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572226.720612:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572226.720854:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518376960 00000100:00100000:2.0:1788572226.720862:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518376960 00000100:00100000:2.0:1788572226.720914:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788572226.720924:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14392:x1875453518376960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572226.721192:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14392:x1875453518376960:12345-0@lo:502:llog_process_th.0 Request processed in 268us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572226.721200:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788572226.723169:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf634c0e-dd8a-4982-ad2a-0f984621b961:14392:1875453518376960:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788572226.723223:0:14392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788572226.725488:0:14343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788572226.725516:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788572226.725543:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386e00/0x977d9e7969c00685 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0068c expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.725557:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041386e00/0x977d9e7969c00685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0068c expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788572226.725614:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788572226.725616:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788572226.725617:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572226.725619:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572226.725620:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572226.725621:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572226.725622:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572226.725624:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788572226.725625:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572226.725627:0:14343:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788572226.725631:0:14343:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788572226.725638:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788572226.725639:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788572226.725640:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572226.725641:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572226.725642:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572226.725643:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572226.725644:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572226.725645:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788572226.725646:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572226.725647:0:14343:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788572226.725688:0:14343:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788572226.725710:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518377088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788572226.725802:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.725840:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.725979:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518377088 00000100:00100000:3.0:1788572226.725988:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518377088 00000100:00100000:3.0:1788572226.726041:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788572226.726051:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14343:x1875453518377088:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788572226.726080:0:14355:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788572226.726096:0:14355:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788572226.814304:0:14355:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788572226.814318:0:14355:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788572226.814398:0:14377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788572226.814404:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788572226.814444:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.814465:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00669 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.814474:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.814516:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c00669 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572226.814532:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c00669 expref: 12 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572226.814548:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875453518377216:0@lo:104: 00000100:00100000:0.0:1788572226.814620:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572226.814667:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0503496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572226.814863:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518377216 00000100:00100000:3.0:1788572226.814872:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518377216 00000100:00100000:3.0:1788572226.814928:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788572226.814939:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:14377:x1875453518377216:12345-0@lo:104: 00010000:00010000:3.0:1788572226.814952:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.815010:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572226.815017:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:14377:x1875453518377216:12345-0@lo:104: Request processed in 81us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572226.815024:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788572226.815061:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875453518377216:0@lo:104: 00010000:00010000:3.0:1788572226.815081:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815299:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572226.815306:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815313:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:1.0:1788572226.815317:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815325:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572226.815332:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572226.815337:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788572226.815369:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815385:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572226.815402:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815408:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041386800/0x977d9e7969c00669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c00670 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815424:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.815426:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572226.815427:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572226.815448:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf634c0e-dd8a-4982-ad2a-0f984621b961:3300:1875453518377344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572226.815477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572226.815518:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518377344 00000100:00100000:1.0:1788572226.815522:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518377344 00010000:00010000:1.0:1788572226.815538:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00669 expref: 13 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572226.815556:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572226.815562:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+13:3300:x1875453518377344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572226.815572:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572226.815576:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00669 expref: 13 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815587:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c00669 expref: 13 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815601:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076995200/0x977d9e7969c00670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c00669 expref: 13 pid: 14355 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815623:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815631:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788572226.815643:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001239931s 00010000:00010000:1.0:1788572226.815648:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815655:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815662:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815668:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815673:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572226.815677:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815684:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815694:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572226.815703:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572226.815743:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:3300:x1875453518377344:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572226.815750:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572226.815775:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf634c0e-dd8a-4982-ad2a-0f984621b961:3300:1875453518377344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572226.815978:0:14377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.815997:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572226.816004:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c05024a400/0x977d9e7969c006a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572226.854606:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14343:x1875453518377088:12345-0@lo:253:mount.lustre.0 Request processed in 128547us (128795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572226.854620:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788572226.854698:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:14343:1875453518377088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788572226.854714:0:14343:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788572226.854727:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788572226.854729:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788572226.854730:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572226.854731:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572226.854733:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572226.854734:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572226.854735:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572226.854737:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788572226.854739:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572226.854740:0:14343:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788572226.854759:0:14343:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788572226.864181:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572226.865035:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788572226.865540:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572226.865685:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788572226.865931:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572226.867415:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788572226.869015:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572226.869173:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788572226.869570:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572226.870057:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788572226.870559:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788572226.870741:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788572226.906507:0:14343:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788572226.906814:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788572226.908462:0:14398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788572226.908561:0:14398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788572226.913504:0:14397:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788572226.913512:0:14397:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1788572226.913860:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788572226.913939:0:14398:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788572226.913944:0:14398:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788572226.914839:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788572226.916147:0:14343:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788572226.916635:0:14343:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788572226.916646:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788572226.916836:0:14343:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572226.918124:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788572226.921190:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788572226.922102:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788572226.925026:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788572226.947470:0:14343:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788572227.013143:0:14343:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788572227.013202:0:14343:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac68c1c6f988 00100000:10000000:2.0:1788572227.013212:0:14343:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788572227.016778:0:14343:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788572227.016801:0:14343:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788572227.016813:0:14343:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788572227.016841:0:14343:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788572227.245221:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788572227.320351:0:14358:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572227.320364:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88bf452dd800 from 6 10000000:01000000:3.0:1788572227.320370:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572227.320417:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572227.320428:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572227.320438:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572227.320462:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518377472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572227.320533:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572227.320583:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572227.320675:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518377472 00000100:00100000:2.0:1788572227.320684:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518377472 00000100:00100000:2.0:1788572227.320762:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788572227.320774:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14358:x1875453518377472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572227.320787:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572227.320801:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c006a8 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572227.320835:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c006a8 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572227.320845:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c006a8 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572227.320855:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0de00, rc 0) 00000100:00100000:2.0:1788572227.320902:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14358:x1875453518377472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572227.320909:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788572227.321165:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518377472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572227.321181:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572227.321191:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572227.321276:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518377600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788572227.321321:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572227.321342:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0503499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572227.321432:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518377600 00000100:00100000:2.0:1788572227.321437:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518377600 00000100:00100000:2.0:1788572227.321467:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788572227.321474:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14358:x1875453518377600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788572227.321487:0:14355:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788572227.321504:0:14355:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788572227.321507:0:14355:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788572227.321594:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14358:x1875453518377600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572227.321601:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788572227.321691:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518377600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788572227.321744:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788572227.321752:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572227.321834:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572227.754877:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788572228.270937:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788572228.781313:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788572229.289218:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572230.317834:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572231.338147:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572231.787958:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572231.788001:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788572231.788004:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572231.788008:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788572231.788010:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788572231.788013:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572231.788017:0:37:0:(import.c:65:import_set_state_nolock()) ffff88c065ad0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572231.788030:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88c065ad0800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788572231.788055:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c07ba42680 x1875453518377856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572231.788756:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518377728:0@lo:400:kworker.0 00000100:00100000:1.0:1788572231.788835:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572231.788904:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518377728 00000100:00100000:1.0:1788572231.788913:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518377728 00000100:00100000:1.0:1788572231.788958:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572231.788966:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:3297:x1875453518377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572231.789012:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:3297:x1875453518377728:12345-0@lo:400:kworker.0 Request processed in 47us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572231.789018:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788572231.789076:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518377728:0@lo:400:kworker.0 00000100:00100000:3.0:1788572231.790081:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518377856:0@lo:38:kworker.0 00000100:00100000:3.0:1788572231.790129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572231.790797:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518377856 00000100:00100000:1.0:1788572231.790808:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518377856 00000100:00100000:1.0:1788572231.790840:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788572231.790848:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1875453518377856:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572231.790877:0:14363:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:1.0:1788572231.790920:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x977d9e7969c006b6 00000004:00100000:1.0:1788572231.790936:0:14363:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572231.791076:0:14363:0:(import.c:65:import_set_state_nolock()) ffff88c06bfd8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572231.791139:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875453518377856:12345-0@lo:38:kworker.0 Request processed in 291us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572231.791146:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788572231.791202:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88c07ba42680 x1875453518377856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572231.791219:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788572231.791228:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788572231.791233:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788572231.791235:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c065ad0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572231.791242:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875453518377856:0@lo:38:kworker.0 00000001:02000400:2.0:1788572232.068580:0:14641:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788572232.383751:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572233.386717:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572234.410417:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572235.432511:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572235.713998:0:14793:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3536e580 20000000:00000080:2.0:1788572235.714016:0:14793:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88c04a522c00 uarg=0000000000000000 20000000:01000000:2.0:1788572235.714047:0:14793:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788572235.714054:0:14793:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788572235.714058:0:14793:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788572235.717103:0:14794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788572235.721508:0:14793:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788572235.726817:0:14793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788572235.726853:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572235.726895:0:14793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00677 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572235.726904:0:14793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572235.726956:0:14793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c00677 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572235.726973:0:14793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c00677 expref: 11 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572235.726988:0:14793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14793:1875453518377984:0@lo:104: 00000100:00100000:0.0:1788572235.727101:0:14793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572235.727215:0:14793:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050349780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572235.727558:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518377984 00000100:00100000:3.0:1788572235.727568:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518377984 00000100:00100000:3.0:1788572235.727617:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572235.727638:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:14793:x1875453518377984:12345-0@lo:104: 00010000:00010000:3.0:1788572235.727653:0:14345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.727734:0:14345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572235.727740:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:14793:x1875453518377984:12345-0@lo:104: Request processed in 116us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.727749:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788572235.727771:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572235.727778:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.727785:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386c00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572235.727789:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.727797:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572235.727804:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572235.727810:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572235.727840:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.727847:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572235.727868:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.727875:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c00677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c0067e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.727902:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572235.727904:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572235.727906:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572235.727927:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf634c0e-dd8a-4982-ad2a-0f984621b961:3298:1875453518378112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572235.727961:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572235.728006:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518378112 00000100:00100000:3.0:1788572235.728009:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518378112 00010000:00010000:3.0:1788572235.728027:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00677 expref: 12 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572235.728047:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572235.728053:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:3298:x1875453518378112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572235.728064:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572235.728069:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00677 expref: 12 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728079:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c00677 expref: 12 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728094:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728103:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728117:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728124:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728138:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728145:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728151:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572235.728155:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728162:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728170:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572235.728179:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572235.728210:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:3298:x1875453518378112:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572235.728216:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572235.728278:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf634c0e-dd8a-4982-ad2a-0f984621b961:3298:1875453518378112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572235.728430:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0d600/0x977d9e7969c0067e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c00677 expref: 11 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572235.728443:0:14793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14793:1875453518377984:0@lo:104: 00010000:00010000:1.0:1788572235.728458:0:14793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572235.728476:0:14793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572235.728482:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572235.728488:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c05024b400/0x977d9e7969c006bd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572236.456579:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788572236.840586:0:14358:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788572236.840596:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf452dd800 from 10 10000000:01000000:3.0:1788572236.840602:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572236.840684:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572236.840696:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572236.840720:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572236.840746:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518378240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572236.840816:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572236.840868:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0509f0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788572236.840976:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518378240 00000100:00100000:0.0:1788572236.840984:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518378240 00000100:00100000:0.0:1788572236.841038:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572236.841048:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+11:14358:x1875453518378240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572236.841060:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572236.841076:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c006c4 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572236.841099:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c006c4 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572236.841109:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c006c4 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572236.841129:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024aa00, rc 0) 00000100:00100000:0.0:1788572236.841174:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14358:x1875453518378240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572236.841181:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788572236.841229:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518378240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572236.841245:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572236.841278:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572236.841331:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518378368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572236.841357:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572236.841388:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050349600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572236.841402:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518378368 00000100:00100000:0.0:1788572236.841406:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518378368 00000100:00100000:0.0:1788572236.841428:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788572236.841433:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14358:x1875453518378368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572236.841687:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14358:x1875453518378368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572236.841694:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788572236.841723:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518378368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572236.841751:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518378496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572236.841789:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572236.841809:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050349600 going to sleep for 11 seconds 00000100:00100000:0.0:1788572236.841821:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518378496 00000100:00100000:0.0:1788572236.841825:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518378496 00000100:00100000:0.0:1788572236.841841:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788572236.841847:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14358:x1875453518378496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572236.841982:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:14358:x1875453518378496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572236.841988:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788572236.842024:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518378496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572236.842745:0:14832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788572236.842796:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788572236.842811:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572236.842820:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572236.842829:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788572236.905319:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572236.905329:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788572236.905331:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572236.905334:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788572236.905509:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572236.905533:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518378624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572236.905604:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572236.905688:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518378624 00000100:00100000:1.0:1788572236.905697:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518378624 00000100:00100000:1.0:1788572236.905747:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572236.905759:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518378624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572236.905812:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518378624:12345-0@lo:400:kworker.0 Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572236.905820:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788572236.905993:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572226/real 1788572226] req@ffff88bf476bb100 x1875453518375168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572236 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572236.906015:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88bf476bb100 x1875453518375168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572236 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572236.906039:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572226/real 1788572226] req@ffff88c0502ad880 x1875453518375040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572236 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572236.906052:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88c0502ad880 x1875453518375040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572236 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572236.906064:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0556c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572236.906077:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788572236.906081:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518375168:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788572236.906087:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0503cd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572236.906091:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788572236.906094:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518375040:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788572236.906116:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572236.906119:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788572236.906122:0:36:0:(import.c:65:import_set_state_nolock()) ffff88c0503cd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572236.906126:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1788572236.906130:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572236.906134:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88c0503cd800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788572236.906153:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c07ba41180 x1875453518378752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572236.906167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572236.906170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788572236.906171:0:36:0:(import.c:65:import_set_state_nolock()) ffff88c0556c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572236.906174:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1788572236.906183:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572236.906187:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88c0556c2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788572236.906200:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c07ba43480 x1875453518378880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572236.906220:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518378752:0@lo:8:kworker.0 00000400:00000100:0.0:1788572236.906268:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875453518378752 offset 0 length 520: 4 00000100:00100000:0.0:1788572236.906294:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518378880:0@lo:8:kworker.0 00000400:00000100:0.0:1788572236.906314:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875453518378880 offset 0 length 520: 4 00010000:00080000:1.0:1788572236.906467:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88c07ba42d80 x1875453518378624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572236.906480:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518378624:0@lo:400:kworker.0 00010000:00010000:3.0:1788572237.480701:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572238.515529:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788572239.018298:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788572239.528481:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.553438:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572241.592348:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788572241.765581:0:15041:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788572241.765585:0:15041:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788572241.765728:0:15041:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88c048290800 00000020:01000004:3.0:1788572241.765743:0:15041:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788572241.765927:0:15041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788572241.765943:0:15041:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88c04a5f19c0) 00000020:00000080:3.0:1788572241.765963:0:15041:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788572241.792027:0:15041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788572241.793735:0:15041:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788572241.795212:0:15041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788572241.795464:0:15041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788572241.795768:0:15041:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788572241.796149:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 455: rc = 0 00100000:10000000:0.0:1788572241.796698:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 455: rc = 0 00100000:10000000:0.0:1788572241.796912:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 455: rc = 0 00100000:10000000:0.0:1788572241.797728:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 689: rc = 0 00100000:10000000:0.0:1788572241.798156:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 689: rc = 0 00100000:10000000:0.0:1788572241.798940:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 689: rc = 0 00100000:10000000:0.0:1788572241.799198:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 689: rc = 0 00100000:10000000:0.0:1788572241.799716:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 689: rc = 0 00100000:10000000:0.0:1788572241.800531:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 689: rc = 0 00000020:00000080:0.0:1788572241.801229:0:15041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788572241.801240:0:15041:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788572241.801423:0:15041:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x977d9e7969c006d9 00000020:01000004:0.0:1788572241.801494:0:15041:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788572241.801519:0:15041:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788572241.801544:0:15041:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788572241.801551:0:15041:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788572241.801566:0:15041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788572241.801588:0:15041:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88c058ee99c0) 00000020:00000080:0.0:1788572241.801600:0:15041:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788572241.803157:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788572241.803608:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788572241.803615:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788572241.806933:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788572241.806946:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788572241.810925:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788572241.810938:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788572241.813312:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788572241.813528:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788572241.813534:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788572241.815156:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788572241.815168:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788572241.832360:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788572241.832637:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788572241.832645:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788572241.834614:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788572241.834625:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788572241.836945:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788572241.838038:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788572241.842005:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788572241.842214:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788572241.842220:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788572241.845868:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788572241.845890:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788572241.901133:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788572241.901462:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788572241.901469:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788572241.902744:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788572241.902767:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788572241.904796:0:15041:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788572241.904825:0:15041:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788572241.904831:0:15041:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788572241.924853:0:15041:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788572241.924893:0:15041:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788572241.924898:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788572241.924900:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788572241.924901:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572241.924903:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572241.924904:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572241.924905:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572241.924907:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788572241.924908:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572241.924909:0:15041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788572241.924913:0:15041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788572241.924915:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788572241.924917:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788572241.924918:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572241.924919:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572241.924920:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572241.924921:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572241.924922:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788572241.924923:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572241.924924:0:15041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788572241.924953:0:15041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788572241.924977:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379008:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788572241.925053:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572241.925167:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050349180 going to sleep for 11 seconds 00000100:00100000:0.0:1788572241.925933:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518379008 00000100:00100000:0.0:1788572241.925945:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518379008 00000100:00100000:0.0:1788572241.926015:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788572241.926027:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:15041:x1875453518379008:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788572241.926080:0:14353:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788572241.926083:0:14353:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788572241.926088:0:14353:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788572241.935402:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:15041:x1875453518379008:12345-0@lo:253:mount.lustre.0 Request processed in 9367us (10339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572241.935419:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788572241.935534:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379008:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788572241.935551:0:15041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788572241.935555:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788572241.935557:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572241.935583:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572241.935585:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572241.935586:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572241.935587:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572241.935589:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572241.935590:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572241.935592:0:15041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788572241.935609:0:15041:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88c048290800 from lustre-OST0000 10000000:01000000:3.0:1788572241.935636:0:15041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788572241.935639:0:15041:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788572241.935646:0:15041:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88c076484d40 local copy 00010000:00010000:3.0:1788572241.935657:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572241.935918:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572241.935959:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.936035:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04a24c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572241.938983:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518379136 00000100:00100000:1.0:1788572241.939000:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518379136 00000100:00100000:1.0:1788572241.939066:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788572241.939090:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:15041:x1875453518379136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572241.939414:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:15041:x1875453518379136:12345-0@lo:501:mount.lustre.0 Request processed in 325us (3452us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572241.939422:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788572241.940687:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379136:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788572241.940722:0:15041:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788572241.940970:0:15041:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788572241.940979:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.940990:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572241.941025:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88c048290800 10000000:01000000:0.0:1788572241.941031:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788572241.941036:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88c076484d40 10000000:01000000:0.0:1788572241.941039:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788572241.941043:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88c076484d40 from 1 10000000:01000000:0.0:1788572241.941046:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788572241.941082:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024b000/0x977d9e7969c006e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.941091:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c05024b000/0x977d9e7969c006e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.941100:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c05024b000/0x977d9e7969c006e7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.941121:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572241.941174:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.941215:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047265cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572241.941422:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518379264 00000100:00100000:2.0:1788572241.941428:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518379264 00000100:00100000:2.0:1788572241.941480:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788572241.941489:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+12:15041:x1875453518379264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572241.941502:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572241.941516:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0ca00/0x977d9e7969c006ee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c006e7 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.941554:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0ca00/0x977d9e7969c006ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c006e7 expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.941565:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0ca00/0x977d9e7969c006ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c006e7 expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.941586:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0ca00, rc 0) 00000100:00100000:2.0:1788572241.941622:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+13:15041:x1875453518379264:12345-0@lo:101:mount.lustre.0 Request processed in 134us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572241.941629:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788572241.941997:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572241.942011:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c05024b000/0x977d9e7969c006e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006ee expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.942021:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c05024b000/0x977d9e7969c006e7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c006ee expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572241.942042:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788572241.942060:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024b000/0x977d9e7969c006e7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006ee expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.942082:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c05024b000/0x977d9e7969c006e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006ee expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572241.942089:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788572241.942093:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788572241.942097:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788572241.942100:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788572241.942118:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024ae00/0x977d9e7969c006f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.942125:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c05024ae00/0x977d9e7969c006f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.942133:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c05024ae00/0x977d9e7969c006f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.942146:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788572241.942176:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.942206:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047265cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572241.942273:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518379392 00000100:00100000:2.0:1788572241.942278:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518379392 00000100:00100000:2.0:1788572241.942318:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572241.942325:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+13:15041:x1875453518379392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572241.942333:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572241.942343:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0c600/0x977d9e7969c006fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c006f5 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.942359:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0c600/0x977d9e7969c006fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c006f5 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.942367:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0c600/0x977d9e7969c006fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c006f5 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.942373:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c600, rc 0) 00000100:00100000:2.0:1788572241.942402:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518379392:12345-0@lo:101:mount.lustre.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572241.942408:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788572241.942483:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572241.942493:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c05024ae00/0x977d9e7969c006f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006fc expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.942501:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c05024ae00/0x977d9e7969c006f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c006fc expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572241.944105:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788572241.947234:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572241.947548:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788572241.947612:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788572241.947645:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788572241.947693:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788572241.947727:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788572241.947774:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788572241.948236:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788572241.948245:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788572241.948382:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572241.948453:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.948504:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047265c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572241.948608:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518379520 00000100:00100000:1.0:1788572241.948616:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518379520 00000100:00100000:1.0:1788572241.948662:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788572241.948671:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518379520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572241.949337:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518379520:12345-0@lo:501:mount.lustre.0 Request processed in 665us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572241.949347:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788572241.949452:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572241.949493:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572241.949538:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.949584:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047265c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572241.949635:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518379648 00000100:00100000:1.0:1788572241.949640:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518379648 00000100:00100000:1.0:1788572241.949715:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788572241.949725:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518379648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572241.950201:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518379648:12345-0@lo:503:mount.lustre.0 Request processed in 476us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572241.950209:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788572241.950307:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379648:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788572241.951323:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572241.951395:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572241.951454:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.955539:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047265c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572241.955625:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518379776 00000100:00100000:2.0:1788572241.955635:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518379776 00000100:00100000:2.0:1788572241.955690:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788572241.955701:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518379776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572241.956275:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518379776:12345-0@lo:502:mount.lustre.0 Request processed in 548us (4793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572241.956284:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788572241.956420:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572241.956732:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788572241.956965:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788572241.957002:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788572241.957053:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788572241.957092:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788572241.957124:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788572241.957189:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788572241.957224:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788572241.958424:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788572241.958525:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788572241.958581:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788572241.958661:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788572241.958713:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572241.959136:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.959183:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047265c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572241.959242:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518379904 00000100:00100000:2.0:1788572241.959273:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518379904 00000100:00100000:2.0:1788572241.959310:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788572241.959318:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518379904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572241.959510:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518379904:12345-0@lo:502:mount.lustre.0 Request processed in 191us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572241.959524:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788572241.959720:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518379904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572241.959997:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788572241.960010:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788572241.961340:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788572241.961350:0:15055:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788572241.961357:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572241.961360:0:15055:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788572241.961365:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788572241.961381:0:15055:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88c058ee8000) 00000020:00000080:0.0:1788572241.961404:0:15055:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788572241.961409:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788572241.961476:0:15055:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88c048290800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788572241.961484:0:15055:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788572241.961494:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x977d9e7969c0070a 00010000:00010000:0.0:1788572241.966613:0:15055:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788572241.967350:0:15055:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1788572241.969394:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788572241.971154:0:15055:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788572241.971166:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572241.971172:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572241.971174:0:15055:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788572241.971177:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788572241.971187:0:15055:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788572241.971189:0:15055:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572241.971191:0:15055:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572241.971193:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788572241.971195:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572241.971197:0:15055:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788572241.971199:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572241.971202:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572241.971203:0:15055:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788572241.971206:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788572241.971208:0:15055:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788572241.971210:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572241.971212:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572241.971213:0:15055:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788572241.971215:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572241.971217:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572241.971218:0:15055:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788572241.971221:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788572241.972170:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572241.972177:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572241.972179:0:15055:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788572241.972183:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788572241.972507:0:15041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788572241.972540:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788572241.972576:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024ae00/0x977d9e7969c006f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006fc expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.972590:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c05024ae00/0x977d9e7969c006f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c006fc expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572241.972599:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c048290800 from 1 10000000:01000000:2.0:1788572241.972602:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788572241.972639:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.972647:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.972658:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572241.972683:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572241.972751:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.972943:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518380032 00000100:00100000:3.0:1788572241.972951:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518380032 00000100:00100000:3.0:1788572241.972995:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788572241.973006:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+14:15041:x1875453518380032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572241.973018:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572241.973032:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c00711 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.973058:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c00711 expref: 15 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.973069:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00711 expref: 15 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.973079:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387800, rc 0) 00000100:00100000:3.0:1788572241.973126:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380032:12345-0@lo:101:mount.lustre.0 Request processed in 122us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572241.973133:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788572241.973208:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572241.973229:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572241.973243:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.973275:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572241.974088:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788572241.974431:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572241.974685:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788572241.974728:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788572241.985509:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788572241.985537:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788572241.985664:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572241.985735:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572241.985787:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572241.986014:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518380160 00000100:00100000:1.0:1788572241.986022:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518380160 00000100:00100000:1.0:1788572241.986070:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788572241.986079:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572241.986346:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380160:12345-0@lo:501:mount.lustre.0 Request processed in 268us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572241.986355:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788572241.986463:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572241.986501:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572241.986552:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572241.986593:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572241.987939:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518380288 00000100:00100000:1.0:1788572241.987960:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518380288 00000100:00100000:1.0:1788572241.988014:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788572241.988024:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572241.988267:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380288:12345-0@lo:503:mount.lustre.0 Request processed in 244us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572241.988275:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572241.988391:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788572241.988981:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788572241.989058:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572241.989107:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572241.989144:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518380416 00000100:00100000:2.0:1788572241.989150:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518380416 00000100:00100000:2.0:1788572241.989194:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572241.989203:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572241.989387:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380416:12345-0@lo:502:mount.lustre.0 Request processed in 184us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572241.989394:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572241.989448:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572241.989464:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788572241.989705:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788572241.989752:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788572241.991205:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788572241.991352:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788572241.991392:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788572241.991454:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788572241.991493:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788572241.991551:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788572241.991614:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572241.991685:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572241.991773:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572241.995109:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518380544 00000100:00100000:1.0:1788572241.995125:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518380544 00000100:00100000:1.0:1788572241.997968:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788572241.997998:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572241.998364:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380544:12345-0@lo:502:mount.lustre.0 Request processed in 380us (6677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572241.998374:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788572241.998541:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572241.998747:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788572241.998764:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788572242.000480:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572242.000492:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572242.000495:0:15059:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788572242.000503:0:15059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c048290800 00000020:00000080:0.0:1788572242.000506:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788572242.000512:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572242.000515:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572242.000516:0:15059:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788572242.000518:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572242.000520:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572242.000522:0:15059:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788572242.000524:0:15059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88c048290800 00000020:00000080:0.0:1788572242.000526:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788572242.000593:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572242.001982:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572242.001986:0:15059:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788572242.001994:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572242.001998:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572242.001999:0:15059:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788572242.002004:0:15059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88c048290800 00000020:00000080:0.0:1788572242.002006:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788572242.003473:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572242.003482:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572242.003484:0:15059:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788572242.003489:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788572242.003772:0:15041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788572242.003818:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572242.006154:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572242.006173:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572242.009028:0:15041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788572242.009038:0:15041:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88c048290800 10000000:01000000:3.0:1788572242.009043:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88c048290800 10000000:01000000:3.0:1788572242.009047:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788572242.009054:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88c048290800 from 1 10000000:01000000:3.0:1788572242.009057:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572242.009127:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c0071f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572242.009140:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c0071f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572242.009151:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c0071f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572242.009176:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572242.009275:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.009325:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0537f7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788572242.010937:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518380672 00000100:00100000:1.0:1788572242.010950:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518380672 00000100:00100000:1.0:1788572242.011005:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788572242.011014:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518380672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572242.011029:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572242.011046:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076995400/0x977d9e7969c00726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c0071f expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572242.011073:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076995400/0x977d9e7969c00726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c0071f expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572242.011085:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076995400/0x977d9e7969c00726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c0071f expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572242.011094:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995400, rc 0) 00000100:00100000:1.0:1788572242.011165:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518380672:12345-0@lo:101:mount.lustre.0 Request processed in 152us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572242.011172:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788572242.012541:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572242.012578:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c0071f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00726 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572242.012590:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c0071f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00726 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572242.014609:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788572242.015527:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572242.018942:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788572242.019068:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788572242.019127:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788572242.019208:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788572242.019261:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788572242.019316:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788572242.019355:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788572242.019408:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788572242.019464:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788572242.019502:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788572242.019538:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788572242.022964:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788572242.023073:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788572242.023111:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788572242.023168:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788572242.023205:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788572242.023234:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788572242.023295:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788572242.023352:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788572242.023388:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788572242.023448:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788572242.023483:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788572242.023516:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788572242.023555:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788572242.023600:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788572242.023631:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788572242.023675:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788572242.023704:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000100:00080000:3.0:1788572242.028893:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788572242.028902:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788572242.028905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788572242.028909:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788572242.029316:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518380800:0@lo:400:kworker.0 00000100:00100000:3.0:1788572242.029380:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.029441:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518380800 00000100:00100000:3.0:1788572242.029450:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518380800 00000100:00100000:3.0:1788572242.029490:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572242.029499:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518380800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572242.029595:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518380800:12345-0@lo:400:kworker.0 Request processed in 96us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572242.029603:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788572242.029648:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88bf476baa00 x1875453518380800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572242.029661:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518380800:0@lo:400:kworker.0 00000040:00080000:3.0:1788572242.029689:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788572242.029713:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788572242.031043:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572242.031103:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.031145:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0537f7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788572242.035089:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518380928 00000100:00100000:1.0:1788572242.035104:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518380928 00000100:00100000:1.0:1788572242.035159:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788572242.035169:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518380928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572242.035501:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518380928:12345-0@lo:501:mount.lustre.0 Request processed in 332us (4396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572242.035510:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788572242.038233:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518380928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572242.038311:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518381056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572242.038384:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.038418:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518381056 00000100:00100000:3.0:1788572242.038425:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518381056 00000100:00100000:3.0:1788572242.038469:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788572242.038479:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518381056:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572242.038677:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518381056:12345-0@lo:503:mount.lustre.0 Request processed in 199us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572242.038685:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788572242.038739:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0537f7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572242.038753:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518381056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788572242.043714:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788572242.043799:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518381184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572242.043881:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.044207:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0537f7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788572242.046434:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518381184 00000100:00100000:1.0:1788572242.046451:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518381184 00000100:00100000:1.0:1788572242.046517:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788572242.046530:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518381184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572242.046881:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518381184:12345-0@lo:502:mount.lustre.0 Request processed in 352us (2997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572242.046889:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788572242.048076:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518381184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572242.048667:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788572242.048735:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788572242.048768:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788572242.048813:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788572242.048847:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788572242.049087:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788572242.049130:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788572242.049184:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788572242.049236:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788572242.049780:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788572242.049852:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788572242.049940:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788572242.050245:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788572242.050487:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788572242.050558:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788572242.050616:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788572242.050667:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788572242.050741:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788572242.050792:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788572242.050834:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788572242.050905:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788572242.050948:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788572242.051147:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788572242.051240:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788572242.051801:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788572242.051844:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788572242.051908:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788572242.051953:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788572242.052130:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788572242.052186:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788572242.052229:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788572242.052364:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788572242.052407:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788572242.052524:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788572242.052592:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788572242.052667:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788572242.052722:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788572242.052762:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788572242.052828:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788572242.052866:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788572242.052930:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518381312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572242.053209:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.053283:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0537f7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572242.054136:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518381312 00000100:00100000:2.0:1788572242.054146:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518381312 00000100:00100000:2.0:1788572242.054200:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788572242.054210:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518381312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572242.054481:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518381312:12345-0@lo:502:mount.lustre.0 Request processed in 272us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572242.054489:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788572242.054565:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518381312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788572242.054672:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788572242.054686:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788572242.059193:0:15065:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788572242.059211:0:15065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88c04a5f4d40) 00000020:00000080:3.0:1788572242.059238:0:15065:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788572242.059370:0:15065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88c048290800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788572242.059374:0:15065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88c048290800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788572242.059377:0:15065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88c048290800 3 00010000:00080000:3.0:1788572242.059417:0:15065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88bf4531b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1788572242.070619:0:15065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788572242.073134:0:15065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788572242.074108:0:15065:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788572242.074127:0:15065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x977d9e7969c00734 00000100:00080000:3.0:1788572242.074140:0:15065:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572242.074156:0:15065:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88bf4531b800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572242.074193:0:15065:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bf476baa00 x1875453518381440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572242.074224:0:15065:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788572242.075867:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518381440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572242.075946:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572242.076023:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518381440 00000100:00100000:1.0:1788572242.076031:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518381440 00000100:00100000:1.0:1788572242.076070:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788572242.076077:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1875453518381440:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788572242.076105:0:14363:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:1.0:1788572242.076141:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x977d9e7969c0073b 00000004:00100000:1.0:1788572242.076155:0:14363:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572242.076193:0:14363:0:(import.c:65:import_set_state_nolock()) ffff88c07b6d5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572242.076453:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875453518381440:12345-0@lo:38:llog_process_th.0 Request processed in 168us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572242.076463:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788572242.076505:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88bf476baa00 x1875453518381440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572242.076516:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572242.076525:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788572242.076532:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788572242.076536:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788572242.076538:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88bf4531b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572242.076544:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1875453518381440:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788572242.077166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572242.077173:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788572242.077175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572242.077179:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788572242.077393:0:15065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788572242.077484:0:15041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788572242.077511:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572242.077536:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c0071f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00726 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.077547:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c041386c00/0x977d9e7969c0071f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00726 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788572242.077608:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788572242.077610:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572242.077612:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572242.077613:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572242.077614:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572242.077616:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572242.077617:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572242.077619:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572242.077621:0:15041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572242.077625:0:15041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788572242.077627:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788572242.077628:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572242.077630:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572242.077631:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572242.077632:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572242.077638:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572242.077639:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572242.077640:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572242.077641:0:15041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788572242.077663:0:15041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788572242.077682:0:15041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518381568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788572242.077741:0:15041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572242.077785:0:15041:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047265cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572242.077914:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518381568 00000100:00100000:2.0:1788572242.077921:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518381568 00000100:00100000:2.0:1788572242.077967:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788572242.077983:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15041:x1875453518381568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788572242.078008:0:14353:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788572242.078020:0:14353:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788572242.139632:0:14353:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572242.139654:0:14353:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788572242.139745:0:14377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788572242.139750:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788572242.139774:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.139792:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c006a8 expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.139812:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.139854:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c006a8 expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.139868:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c006a8 expref: 16 pid: 14353 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572242.139882:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875453518381696:0@lo:104: 00000100:00100000:0.0:1788572242.139947:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572242.139995:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07c3730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572242.140115:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518381696 00000100:00100000:2.0:1788572242.140124:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518381696 00000100:00100000:2.0:1788572242.140182:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788572242.140193:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:14377:x1875453518381696:12345-0@lo:104: 00010000:00010000:2.0:1788572242.140206:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572242.140296:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572242.140302:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:14377:x1875453518381696:12345-0@lo:104: Request processed in 112us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572242.140309:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788572242.140375:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572242.140381:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140407:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387e00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572242.140412:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140420:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572242.140427:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572242.140432:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572242.140505:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140513:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572242.140533:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140540:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387e00/0x977d9e7969c006a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c006af expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140558:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572242.140560:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572242.140561:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572242.140584:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572242.140594:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf634c0e-dd8a-4982-ad2a-0f984621b961:3298:1875453518381824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572242.140624:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572242.140665:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518381824 00000100:00100000:0.0:1788572242.140669:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518381824 00010000:00010000:0.0:1788572242.140697:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c006a8 expref: 17 pid: 14353 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572242.140720:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572242.140727:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:3298:x1875453518381824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572242.140737:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572242.140742:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c006a8 expref: 17 pid: 14353 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140752:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c006a8 expref: 17 pid: 14353 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140768:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140776:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788572242.140790:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001239931s 00010000:00010000:0.0:1788572242.140806:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140814:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140821:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140828:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140833:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ba00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572242.140843:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140852:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140861:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.140870:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572242.140901:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:3298:x1875453518381824:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572242.140909:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572242.140952:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf634c0e-dd8a-4982-ad2a-0f984621b961:3298:1875453518381824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572242.140983:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c058a0de00/0x977d9e7969c006af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c006a8 expref: 16 pid: 14353 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572242.140995:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875453518381696:0@lo:104: 00010000:00010000:0.0:1788572242.141007:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.141016:0:14377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.141023:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572242.141030:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c05024ba00/0x977d9e7969c00742 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572242.147294:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:15041:x1875453518381568:12345-0@lo:253:mount.lustre.0 Request processed in 69300us (69541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572242.147309:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788572242.147477:0:15041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15041:1875453518381568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572242.147494:0:15041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788572242.147497:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572242.147499:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572242.147500:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572242.147502:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572242.147503:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572242.147504:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572242.147506:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572242.147508:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572242.147509:0:15041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788572242.147526:0:15041:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788572242.151655:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788572242.151901:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788572242.152058:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788572242.152206:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788572242.152373:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788572242.152599:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788572242.153918:0:15041:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788572242.215020:0:15041:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788572242.215028:0:15041:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788572242.215071:0:15041:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788572242.215134:0:15041:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788572242.215151:0:15041:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788572242.215180:0:15041:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788572242.601392:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572243.624445:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788572244.143747:0:14358:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788572244.143756:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88bf452dd800 from 7 10000000:01000000:1.0:1788572244.143761:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788572244.143804:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572244.143817:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572244.143829:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572244.143854:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518381952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572244.143919:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572244.143974:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0515b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572244.144004:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518381952 00000100:00100000:3.0:1788572244.144013:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518381952 00000100:00100000:3.0:1788572244.144063:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788572244.144074:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+15:14358:x1875453518381952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572244.144089:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572244.144105:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c00749 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.144144:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c00749 expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.144157:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00749 expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572244.144167:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c041387a00, rc 0) 00000100:00100000:3.0:1788572244.144225:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:14358:x1875453518381952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.144232:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788572244.144365:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518381952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572244.144386:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572244.144395:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572244.144440:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518382080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788572244.144467:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572244.144504:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0515b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572244.144905:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518382080 00000100:00100000:3.0:1788572244.144911:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518382080 00000100:00100000:2.0:1788572244.144956:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788572244.145568:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:14358:x1875453518382080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788572244.145591:0:14356:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788572244.145609:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788572244.145613:0:14356:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788572244.145720:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:14358:x1875453518382080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572244.145838:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518382080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788572244.145904:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788572244.145914:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572244.145924:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572244.147674:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1788572244.650614:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572245.673581:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572246.696519:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572247.148079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788572247.148087:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788572247.148089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788572247.148092:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788572247.148127:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572247.148146:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518382208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572247.148211:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572247.148265:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518382208 00000100:00100000:0.0:1788572247.148274:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518382208 00000100:00100000:1.0:1788572247.148286:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518382336:0@lo:400:kworker.0 00000100:00100000:0.0:1788572247.148317:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788572247.148318:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572247.148326:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:3297:x1875453518382208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572247.148336:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572247.148342:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518382464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572247.148361:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572247.148373:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:3297:x1875453518382208:12345-0@lo:400:kworker.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572247.148381:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788572247.148389:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518382336 00000100:00100000:1.0:1788572247.148392:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518382336 00000100:00100000:1.0:1788572247.148412:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518382464 00000100:00100000:1.0:1788572247.148415:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518382464 00000100:00100000:0.0:1788572247.148426:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518382208:0@lo:400:kworker.0 00000100:00100000:1.0:1788572247.148437:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788572247.148442:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518382336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572247.148471:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788572247.148474:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518382336:12345-0@lo:400:kworker.0 Request processed in 32us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572247.148480:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572247.148483:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788572247.148491:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788572247.148497:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518382464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572247.148535:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518382464:12345-0@lo:400:kworker.0 Request processed in 26us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572247.148541:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788572247.148569:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bf47695180 x1875453518382464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572247.148581:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518382464:0@lo:400:kworker.0 00010000:00080000:1.0:1788572247.148591:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bf47695500 x1875453518382336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572247.148598:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518382336:0@lo:400:kworker.0 00000100:00080000:2.0:1788572247.148916:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788572247.721716:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572248.745581:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788572249.103398:0:15412:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1788572249.264745:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788572249.768477:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572250.792414:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572251.312529:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572236/real 1788572236] req@ffff88c07ba41180 x1875453518378752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572251 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572251.312568:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88c07ba41180 x1875453518378752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572251 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572251.312579:0:3296:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572236/real 1788572236] req@ffff88c07ba43480 x1875453518378880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572251 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572251.312613:0:3296:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88c07ba43480 x1875453518378880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788572251 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572251.312632:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0503cd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572251.312653:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788572251.312657:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518378752:0@lo:8:kworker.0 00000100:00080000:3.0:1788572251.312663:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0556c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572251.312668:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788572251.312671:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518378880:0@lo:8:kworker.0 00000100:00080000:2.0:1788572251.312877:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572251.312882:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572251.312885:0:37:0:(import.c:65:import_set_state_nolock()) ffff88c0503cd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572251.312890:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1788572251.312895:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572251.312903:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88c0503cd800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788572251.312922:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c0502ad500 x1875453518382720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572251.312934:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788572251.312937:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788572251.312939:0:37:0:(import.c:65:import_set_state_nolock()) ffff88c0556c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572251.312941:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1788572251.312944:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572251.312947:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88c0556c2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788572251.312956:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c0502ae300 x1875453518382848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572251.313000:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572251.313012:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518383104:0@lo:400:kworker.0 00000100:00100000:2.0:1788572251.313088:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572251.313147:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518383104 00000100:00100000:2.0:1788572251.313155:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518383104 00000100:00100000:2.0:1788572251.313208:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788572251.313218:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518383104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572251.313293:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518383104:12345-0@lo:400:kworker.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572251.313301:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788572251.313323:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788572251.313351:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c0502ac700 x1875453518383104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572251.313364:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518383104:0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.313442:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518382592:0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.313475:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572251.313514:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572251.313521:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518382976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.313546:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572251.313571:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518382976 00000100:00100000:0.0:1788572251.313575:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518382976 00000100:00100000:0.0:1788572251.313599:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788572251.313606:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518382976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572251.313642:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518382976:12345-0@lo:400:kworker.0 Request processed in 37us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572251.313648:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788572251.313677:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c0502ac000 x1875453518382976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572251.313687:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518382976:0@lo:400:kworker.0 00000100:00100000:3.0:1788572251.313819:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518382720:0@lo:8:kworker.0 00000100:00100000:3.0:1788572251.313852:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.313881:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518382848:0@lo:8:kworker.0 00000100:00100000:3.0:1788572251.313922:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572251.314022:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518382720 00000100:00100000:1.0:1788572251.314027:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518382720 00000100:00100000:2.0:1788572251.314094:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518382592 00000100:00100000:2.0:1788572251.314097:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518382592 00000100:00100000:2.0:1788572251.314121:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788572251.314127:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:3297:x1875453518382592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572251.314158:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:3297:x1875453518382592:12345-0@lo:400:kworker.0 Request processed in 31us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572251.314164:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788572251.314212:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518382848 00000100:00100000:1.0:1788572251.314216:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518382848 00000100:00100000:3.0:1788572251.315599:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788572251.315610:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1875453518382720:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788572251.315639:0:15045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1788572251.315671:0:15045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c00757 00002000:00100000:3.0:1788572251.315687:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88bf4531f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788572251.315692:0:15045:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788572251.315694:0:15045:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788572251.316041:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788572251.316070:0:15045:0:(import.c:65:import_set_state_nolock()) ffff88bf4531f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572251.316155:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1875453518382720:12345-0@lo:8:kworker.0 Request processed in 543us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572251.316176:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788572251.316198:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572251.316202:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1875453518382848:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788572251.316214:0:15045:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572251.316241:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1875453518382848:12345-0@lo:8:kworker.0 Request processed in 37us (2318us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572251.316272:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788572251.316370:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c0502ad500 x1875453518382720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788572271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572251.316383:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788572251.316391:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788572251.316400:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788572251.316405:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788572251.316407:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0503cd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788572251.316450:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788572251.316456:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518382720:0@lo:8:kworker.0 00000100:00080000:2.0:1788572251.316474:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0556c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572251.316479:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572251.316482:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518382848:0@lo:8:kworker.0 00000004:00080000:3.0:1788572251.316731:0:14384:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788572251.316754:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14384:1875453518383360:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788572251.316789:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.316812:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cb0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788572251.316830:0:14383:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788572251.317075:0:14383:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 472107825968ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788572251.317095:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572251.317104:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518383232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572251.317132:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.318241:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518383360 00000100:00100000:3.0:1788572251.318275:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518383360 00000100:00100000:3.0:1788572251.318325:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788572251.318335:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14384:x1875453518383360:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788572251.320875:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518383232 00000100:00100000:1.0:1788572251.320886:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518383232 00000100:00100000:1.0:1788572251.320928:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572251.320937:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518383232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572251.320969:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572251.321056:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518383232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (3922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572251.321064:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788572251.321121:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bf476bb480 x1875453518383232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572251.321143:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518383232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572251.323946:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518382592:0@lo:400:kworker.0 00000100:00080000:3.0:1788572251.328585:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788572251.330590:0:15045:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788572251.330601:0:15045:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788572251.330606:0:15045:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1788572251.344751:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.344765:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.344790:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.344796:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.344803:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.344822:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.344834:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.344843:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.344878:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572251.348218:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.348235:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.348276:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.348282:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.348288:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.348304:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.348327:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.348336:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.348360:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788572251.348931:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.348938:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.348946:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.348950:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.348954:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.348964:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.348973:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.348980:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.349000:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788572251.349374:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.349380:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.349388:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.349391:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.349395:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.349403:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.349410:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.349417:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.349425:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788572251.349976:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572251.349986:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.349996:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041386800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.350001:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350014:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350048:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350056:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000013a8bee/0x977d9e7969c0075e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350080:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572251.350085:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350091:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387e00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.350095:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350102:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350112:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350119:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019cc6233/0x977d9e7969c00765 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350131:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572251.350134:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350146:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.350149:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350157:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350168:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350174:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b97527f/0x977d9e7969c0076c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350186:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572251.350189:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350196:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4ce00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.350199:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350206:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350216:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350229:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e39e6b0/0x977d9e7969c00773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.350244:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.350269:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.350272:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.350452:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.350459:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.350467:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.350475:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.350480:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.350501:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.350509:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.350517:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.350537:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572251.351085:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.351092:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.351103:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.351107:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.351110:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.351120:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.351128:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.351141:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.351149:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572251.351545:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572251.351551:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351559:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4da00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.351563:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351572:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351586:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351594:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c0077a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351611:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572251.351615:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351626:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.351630:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351638:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351649:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351655:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c00781 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.351667:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.351669:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.351671:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.351897:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.351904:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.351913:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.351916:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.351920:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.351930:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.351938:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.351946:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.352000:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572251.352444:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.352450:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.352464:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.352467:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.352472:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.352481:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.352500:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.352508:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354332:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572251.354347:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354359:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.354363:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354373:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354401:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354409:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c00788 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354439:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572251.354443:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354450:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.354454:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354461:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354471:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.354479:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.354481:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.354482:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572251.354572:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572251.354580:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c0078f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.357370:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.357893:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.357906:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.357927:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.357933:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.357941:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.357971:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.357983:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.357991:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.358024:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572251.358821:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572251.358832:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572251.358843:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4ca00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572251.358848:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572251.358858:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572251.358882:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572251.358890:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c00796 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572251.358917:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572251.358919:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572251.358921:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572251.359668:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.361141:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.361154:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361171:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.361176:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.361183:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361198:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361208:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361226:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361278:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572251.361776:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.361783:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361793:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.361796:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.361800:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361810:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361819:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361826:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361845:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572251.361857:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572251.361863:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361876:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572251.361881:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361890:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361906:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361915:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c0079d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361937:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572251.361940:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361947:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572251.361950:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361956:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361965:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361979:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.361996:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572251.361998:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572251.362000:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.362459:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.362466:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.362474:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.362477:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.362481:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.363158:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572251.366869:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.366889:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.366899:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.370104:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572251.370833:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572251.370850:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.370863:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.370869:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.370883:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.370911:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.370920:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5ece255/0x977d9e7969c007ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.370947:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.370949:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.370951:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.371650:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.371667:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.371682:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.371688:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.371695:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.371712:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.373855:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.373865:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.373887:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572251.374525:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.374535:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.374553:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.374558:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.374566:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.374583:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.374601:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.374608:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.374623:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572251.375075:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572251.375088:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375099:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.375105:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375128:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375150:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375159:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008af00ea1/0x977d9e7969c007b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375190:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572251.375194:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375200:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.375203:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375210:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375220:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375227:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000461cc462/0x977d9e7969c007b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.375277:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.375279:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.375281:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.375410:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.380367:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.380383:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.380408:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.380414:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.380424:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.380443:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.380454:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.380462:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.380843:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572251.381464:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.381472:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381485:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.381501:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.381506:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381518:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381528:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381536:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381557:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572251.381569:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572251.381577:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381586:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572251.381599:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381609:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381630:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381639:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f840ba9e/0x977d9e7969c007c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381668:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572251.381671:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381678:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4de00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572251.381682:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381689:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381698:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381706:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c007c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.381799:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572251.381801:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572251.381803:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.382220:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.382226:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382236:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.382240:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.382244:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382296:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382306:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382313:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382327:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572251.382335:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572251.382339:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382355:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572251.382359:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382367:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382377:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382384:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c007ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.382398:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572251.382400:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572251.382402:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.383009:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.384841:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.384854:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.384869:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.384873:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.384879:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.384892:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.384909:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.384917:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.384938:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572251.385397:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.385403:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385412:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.385416:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.385420:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385429:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385437:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385445:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385465:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788572251.385827:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.385833:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385841:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.385844:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.385848:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385857:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385865:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385872:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.385879:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788572251.386238:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.386243:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386275:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.386283:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.386287:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386296:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386303:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386309:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386316:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788572251.386704:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.386709:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386717:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.386720:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.386724:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386733:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386742:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386754:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.386763:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788572251.387127:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.387133:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.387141:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.387144:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.387148:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.387157:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.387165:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.387171:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.387179:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788572251.387851:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788572251.387859:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387869:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4c400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.387874:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387884:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387902:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387909:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb04415/0x977d9e7969c007d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387933:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788572251.387936:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387955:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.387958:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387966:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387976:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387983:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a8ae32/0x977d9e7969c007dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.387997:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572251.388000:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388006:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4dc00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.388008:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388015:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388024:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388037:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4d8450c/0x977d9e7969c007e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388051:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572251.388055:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388061:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4cc00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.388064:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388072:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388082:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388089:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086bce5af/0x977d9e7969c007ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388100:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572251.388103:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388109:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4ca00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.388118:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388126:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388136:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388143:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b8348b/0x977d9e7969c007f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388156:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572251.388159:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388165:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572251.388168:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388174:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388183:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388189:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b35224c/0x977d9e7969c007f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572251.388208:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.388210:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.388212:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.388220:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572251.394707:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.394961:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.394986:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.394992:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.394998:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.395013:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.395024:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.395032:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.395068:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788572251.395617:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.395623:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.395633:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.395637:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.395641:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.395651:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.395672:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.395679:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.395695:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788572251.398170:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.398182:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398197:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.398202:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.398209:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398223:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398233:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398241:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398285:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788572251.398717:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572251.398723:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398732:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788572251.398736:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572251.398740:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398750:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398759:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398767:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572251.398775:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:3.0:1788572251.398937:0:15045:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1788572251.399041:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14384:x1875453518383360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 80704us (82247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572251.399053:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788572251.399116:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14384:1875453518383360:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788572251.399142:0:14384:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788572251.399188:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14384:1875453518383488:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788572251.399222:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572251.399281:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572251.399298:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518383488 00000100:00100000:3.0:1788572251.399304:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518383488 00000100:00100000:3.0:1788572251.399348:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572251.399356:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14384:x1875453518383488:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788572251.399390:0:15044:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1788572251.403629:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572251.403647:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403661:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572251.403667:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403693:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403728:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403737:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016f300ff/0x977d9e7969c007ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403761:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572251.403765:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403771:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4da00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572251.403774:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403782:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403791:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403798:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008037a95/0x977d9e7969c00806 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403822:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572251.403826:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403833:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572251.403836:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403844:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403855:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403861:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079ca412a/0x977d9e7969c0080d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403872:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572251.403875:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403880:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4de00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572251.403883:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403902:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403911:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403919:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d60a0c54/0x977d9e7969c00814 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572251.403932:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572251.403934:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572251.403936:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572251.408045:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14384:x1875453518383488:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8683us (8815us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788572251.408058:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572251.408127:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14384:1875453518383488:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788572251.408143:0:14384:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788572251.408626:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572251.432267:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788572251.829842:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572252.841955:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788572252.911233:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788572252.911301:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788572253.865208:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572254.888512:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572255.912648:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572256.361989:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518383616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572256.362060:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572256.362608:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518383616 00000100:00100000:3.0:1788572256.362616:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518383616 00000100:00100000:3.0:1788572256.362664:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788572256.362674:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:3297:x1875453518383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572256.364364:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518383744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572256.364433:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572256.364518:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518383744 00000100:00100000:2.0:1788572256.364524:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518383744 00000100:00100000:2.0:1788572256.364569:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572256.364577:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518383744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572256.364624:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518383744:12345-0@lo:400:kworker.0 Request processed in 48us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572256.364632:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572256.364669:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788572256.364687:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518383744:0@lo:400:kworker.0 00000100:00080000:2.0:1788572256.364729:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572256.365421:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:3297:x1875453518383616:12345-0@lo:400:kworker.0 Request processed in 2746us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572256.365432:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788572256.366576:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518383616:0@lo:400:kworker.0 00000100:00080000:0.0:1788572256.368602:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788572256.368611:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788572256.368614:0:36:0:(import.c:65:import_set_state_nolock()) ffff88c0556c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572256.368621:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1788572256.368627:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572256.368634:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88c0556c2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788572256.368674:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88c07ba40e00 x1875453518383872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572256.368765:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518384128:0@lo:400:kworker.0 00000100:00100000:0.0:1788572256.368833:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572256.369158:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572256.369166:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788572256.369189:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572256.369218:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518384128 00000100:00100000:0.0:1788572256.369224:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518384128 00000100:00100000:0.0:1788572256.369294:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518384000 00000100:00100000:0.0:1788572256.369297:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518384000 00000100:00100000:0.0:1788572256.369315:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788572256.369322:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518384128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572256.369365:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518384128:12345-0@lo:400:kworker.0 Request processed in 43us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.369373:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788572256.369388:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788572256.369393:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518384000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572256.369414:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518384000:12345-0@lo:400:kworker.0 Request processed in 22us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.369420:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788572256.369461:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c07ba40000 x1875453518384000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572256.369474:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518384000:0@lo:400:kworker.0 00010000:00080000:0.0:1788572256.369484:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88c07ba42a00 x1875453518384128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572256.369913:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518384128:0@lo:400:kworker.0 00000100:00080000:0.0:1788572256.369946:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572256.373068:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518383872:0@lo:8:kworker.0 00000100:00100000:3.0:1788572256.373144:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572256.373205:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518383872 00000100:00100000:3.0:1788572256.373213:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518383872 00000100:00100000:3.0:1788572256.373291:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572256.373298:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1875453518383872:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788572256.373317:0:15045:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572256.385530:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572256.385552:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518384256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572256.385621:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572256.385671:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518384256 00000100:00100000:0.0:1788572256.385678:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518384256 00000100:00100000:0.0:1788572256.388009:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788572256.388025:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518384256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572256.388063:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572256.388137:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518384256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.388145:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788572256.388201:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518384256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572256.431820:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1875453518383872:12345-0@lo:8:kworker.0 Request processed in 58513us (58667us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572256.431834:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788572256.432006:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0556c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572256.432012:0:3296:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572256.432016:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518383872:0@lo:8:kworker.0 00000020:01000004:3.0:1788572256.613524:0:15764:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788572256.613528:0:15764:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788572256.613667:0:15764:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88bf4531a000 00000020:01000004:3.0:1788572256.613681:0:15764:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788572256.613694:0:15764:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788572256.613706:0:15764:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88c04a5f3380) 00000020:00000080:3.0:1788572256.613721:0:15764:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788572256.666838:0:15764:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788572256.667112:0:15764:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788572256.672642:0:15764:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788572256.672941:0:15764:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788572256.673150:0:15764:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788572256.674049:0:15764:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 501: rc = 0 00100000:10000000:3.0:1788572256.674147:0:15764:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 501: rc = 0 00100000:10000000:3.0:1788572256.674921:0:15764:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 501: rc = 0 00100000:10000000:3.0:1788572256.677143:0:15764:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 698: rc = 0 00100000:10000000:3.0:1788572256.679071:0:15764:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 698: rc = 0 00100000:10000000:3.0:1788572256.680825:0:15764:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 698: rc = 0 00100000:10000000:3.0:1788572256.681093:0:15764:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 698: rc = 0 00100000:10000000:3.0:1788572256.681572:0:15764:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 698: rc = 0 00100000:10000000:3.0:1788572256.683399:0:15764:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 698: rc = 0 00000020:00000080:3.0:1788572256.685053:0:15764:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788572256.685066:0:15764:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788572256.685077:0:15764:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x977d9e7969c00822 00000020:01000004:3.0:1788572256.685085:0:15764:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788572256.685106:0:15764:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788572256.685109:0:15764:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788572256.685115:0:15764:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788572256.685135:0:15764:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788572256.685138:0:15764:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788572256.712766:0:15764:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788572256.712807:0:15764:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.102@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788572256.712812:0:15764:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788572256.712813:0:15764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788572256.712814:0:15764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572256.712816:0:15764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572256.712817:0:15764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572256.712818:0:15764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572256.712820:0:15764:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788572256.712821:0:15764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572256.712823:0:15764:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788572256.712827:0:15764:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788572256.712829:0:15764:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788572256.712830:0:15764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788572256.712831:0:15764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572256.712833:0:15764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572256.712834:0:15764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572256.712835:0:15764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572256.712836:0:15764:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788572256.712837:0:15764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572256.712838:0:15764:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788572256.712865:0:15764:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788572256.712886:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788572256.712959:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.713027:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c056152900 going to sleep for 11 seconds 00000100:00100000:2.0:1788572256.713295:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518384384 00000100:00100000:2.0:1788572256.713304:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518384384 00000100:00100000:2.0:1788572256.713352:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788572256.713362:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15764:x1875453518384384:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788572256.713403:0:14355:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788572256.713407:0:14355:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788572256.713411:0:14355:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788572256.745924:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15764:x1875453518384384:12345-0@lo:253:mount.lustre.0 Request processed in 32555us (32956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.745939:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788572256.746400:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384384:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788572256.746436:0:15764:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788572256.746460:0:15764:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788572256.746462:0:15764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788572256.746463:0:15764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572256.746464:0:15764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572256.746465:0:15764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572256.746467:0:15764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572256.746468:0:15764:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788572256.746470:0:15764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572256.746471:0:15764:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788572256.746491:0:15764:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88bf4531a000 from lustre-OST0001 10000000:01000000:1.0:1788572256.746518:0:15764:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788572256.746521:0:15764:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788572256.747402:0:15764:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88c076484d40 local copy 00010000:00010000:1.0:1788572256.747415:0:15764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572256.747777:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572256.747833:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.747881:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04703c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572256.748093:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518384512 00000100:00100000:3.0:1788572256.748100:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518384512 00000100:00100000:3.0:1788572256.748150:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788572256.748160:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15764:x1875453518384512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572256.748564:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15764:x1875453518384512:12345-0@lo:501:mount.lustre.0 Request processed in 403us (729us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572256.748572:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788572256.749840:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384512:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788572256.749866:0:15764:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788572256.750072:0:15764:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788572256.750082:0:15764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572256.750092:0:15764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c05024bc00/0x977d9e7969c005cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c005d6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572256.750129:0:15764:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88bf4531a000 10000000:01000000:1.0:1788572256.750134:0:15764:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788572256.750140:0:15764:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788572256.750143:0:15764:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788572256.750147:0:15764:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788572256.750150:0:15764:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788572256.750178:0:15764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572256.750832:0:15764:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572256.750844:0:15764:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572256.750871:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572256.750927:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.750964:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04703c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572256.751048:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518384640 00000100:00100000:0.0:1788572256.751055:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518384640 00000100:00100000:0.0:1788572256.751105:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788572256.751114:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:15764:x1875453518384640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572256.751126:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572256.751141:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024a800/0x977d9e7969c00830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c00829 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.751162:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024a800/0x977d9e7969c00830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c00829 expref: 17 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.751325:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024a800/0x977d9e7969c00830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00829 expref: 17 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.751334:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a800, rc 0) 00000100:00100000:0.0:1788572256.751371:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518384640:12345-0@lo:101:mount.lustre.0 Request processed in 259us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.751378:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788572256.751470:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572256.751484:0:15764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00830 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572256.751493:0:15764:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00830 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572256.753319:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788572256.758402:0:15764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572256.760072:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788572256.760157:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788572256.761046:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788572256.762542:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788572256.762632:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788572256.762999:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788572256.763149:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788572256.763158:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788572256.763909:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572256.764025:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.764145:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04703cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572256.765461:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518384768 00000100:00100000:3.0:1788572256.765471:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518384768 00000100:00100000:3.0:1788572256.765787:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788572256.765798:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518384768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572256.769008:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518384768:12345-0@lo:501:mount.lustre.0 Request processed in 3205us (4975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.769021:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788572256.769791:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572256.769845:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572256.769906:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.769946:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04703cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572256.770285:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518384896 00000100:00100000:0.0:1788572256.770292:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518384896 00000100:00100000:0.0:1788572256.770345:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788572256.770355:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518384896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572256.772054:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518384896:12345-0@lo:503:mount.lustre.0 Request processed in 1692us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.772065:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788572256.772384:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518384896:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788572256.778381:0:15764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788572256.778501:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572256.778591:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.778630:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07ba653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572256.778981:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518385024 00000100:00100000:2.0:1788572256.778990:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518385024 00000100:00100000:2.0:1788572256.779043:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788572256.779053:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518385024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572256.779342:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518385024:12345-0@lo:502:mount.lustre.0 Request processed in 290us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572256.779357:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788572256.779521:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572256.781789:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788572256.781877:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788572256.781913:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788572256.781966:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788572256.782006:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788572256.782041:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788572256.782088:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788572256.782136:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788572256.782198:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788572256.783912:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572256.784026:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.784303:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07ba653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572256.787399:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518385152 00000100:00100000:0.0:1788572256.787419:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518385152 00000100:00100000:0.0:1788572256.787607:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788572256.787619:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518385152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572256.787903:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518385152:12345-0@lo:502:mount.lustre.0 Request processed in 285us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.787912:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788572256.788014:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572256.788142:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788572256.788158:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788572256.797787:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788572256.797801:0:15766:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788572256.797807:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572256.797810:0:15766:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788572256.797815:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788572256.797829:0:15766:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88c048548000) 00000020:00000080:1.0:1788572256.797851:0:15766:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788572256.797857:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788572256.797921:0:15766:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf4531a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788572256.797929:0:15766:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788572256.797937:0:15766:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x977d9e7969c0083e 00010000:00010000:3.0:1788572256.810760:0:15766:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788572256.811519:0:15766:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788572256.818929:0:15766:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788572256.822645:0:15766:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788572256.822656:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572256.822676:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572256.822679:0:15766:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788572256.822684:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572256.822688:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572256.822690:0:15766:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788572256.822693:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788572256.822694:0:15766:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788572256.822696:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572256.822698:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572256.822700:0:15766:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788572256.822701:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572256.822703:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572256.822704:0:15766:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788572256.822708:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788572256.822767:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572256.822770:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572256.822772:0:15766:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788572256.822775:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788572256.828212:0:15764:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788572256.828280:0:15764:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788572256.828298:0:15764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00829 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00830 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572256.828312:0:15764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076995e00/0x977d9e7969c00829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00830 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572256.828322:0:15764:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf4531a000 from 1 10000000:01000000:1.0:1788572256.828325:0:15764:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572256.828362:0:15764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572256.828378:0:15764:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572256.828389:0:15764:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572256.828413:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788572256.828488:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.828536:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07ba65780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572256.828809:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518385280 00000100:00100000:0.0:1788572256.828817:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518385280 00000100:00100000:0.0:1788572256.828884:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788572256.828895:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:15764:x1875453518385280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572256.828910:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572256.828923:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c00845 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.828951:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c00845 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.828961:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00845 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.828970:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b400, rc 0) 00000100:00100000:0.0:1788572256.829020:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385280:12345-0@lo:101:mount.lustre.0 Request processed in 127us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.829027:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788572256.833717:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572256.833745:0:15764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572256.833756:0:15764:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572256.834767:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788572256.835136:0:15764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788572256.837623:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788572256.838508:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788572256.838586:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788572256.838593:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788572256.839364:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572256.839450:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.839493:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07ba65780 going to sleep for 11 seconds 00000100:00100000:0.0:1788572256.840001:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518385408 00000100:00100000:0.0:1788572256.840010:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518385408 00000100:00100000:0.0:1788572256.840058:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788572256.840066:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572256.840325:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385408:12345-0@lo:501:mount.lustre.0 Request processed in 259us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.840333:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788572256.840760:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572256.840795:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572256.840842:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.840872:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07ba65780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572256.840920:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518385536 00000100:00100000:2.0:1788572256.840925:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518385536 00000100:00100000:2.0:1788572256.840954:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788572256.840961:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572256.841243:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385536:12345-0@lo:503:mount.lustre.0 Request processed in 281us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572256.841275:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788572256.841430:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788572256.841903:0:15764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788572256.841972:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572256.842010:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.842044:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07ba65780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572256.842169:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518385664 00000100:00100000:2.0:1788572256.842174:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518385664 00000100:00100000:2.0:1788572256.842219:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788572256.842227:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572256.842429:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385664:12345-0@lo:502:mount.lustre.0 Request processed in 203us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572256.842437:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788572256.842794:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572256.843010:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788572256.843051:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788572256.843090:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788572256.843119:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788572256.843145:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788572256.843239:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788572256.843342:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788572256.843375:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788572256.843403:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572256.843456:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572256.843482:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07ba65780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572256.844450:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518385792 00000100:00100000:2.0:1788572256.844461:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518385792 00000100:00100000:2.0:1788572256.844506:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788572256.844514:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf450c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572256.844805:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf450c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385792:12345-0@lo:502:mount.lustre.0 Request processed in 292us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572256.844813:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788572256.845018:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788572256.845138:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788572256.845150:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788572256.847307:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572256.847321:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572256.847323:0:15770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788572256.847330:0:15770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bf4531a000 00000020:00000080:3.0:1788572256.847333:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788572256.847349:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572256.847351:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572256.847352:0:15770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788572256.847355:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572256.847357:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572256.847359:0:15770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788572256.847362:0:15770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88bf4531a000 00000020:00000080:3.0:1788572256.847364:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788572256.847427:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572256.847430:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572256.847431:0:15770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788572256.847434:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572256.847436:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572256.847446:0:15770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788572256.847451:0:15770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88bf4531a000 00000020:00000080:3.0:1788572256.847453:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788572256.847489:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572256.847493:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572256.847495:0:15770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788572256.847498:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788572256.855879:0:15764:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788572256.855926:0:15764:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572256.855948:0:15764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572256.855974:0:15764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572256.856033:0:15764:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788572256.856036:0:15764:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88bf4531a000 10000000:01000000:2.0:1788572256.856039:0:15764:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88bf4531a000 10000000:01000000:2.0:1788572256.856043:0:15764:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788572256.856049:0:15764:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88bf4531a000 from 1 10000000:01000000:2.0:1788572256.856052:0:15764:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788572256.856088:0:15764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0d600/0x977d9e7969c00853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572256.856097:0:15764:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c058a0d600/0x977d9e7969c00853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572256.856108:0:15764:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c058a0d600/0x977d9e7969c00853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572256.856131:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788572256.856199:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572256.856274:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c076587c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572256.856336:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518385920 00000100:00100000:0.0:1788572256.856344:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518385920 00000100:00100000:0.0:1788572256.856387:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788572256.856396:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c04a0e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518385920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572256.856408:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572256.856420:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024a600/0x977d9e7969c0085a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c00853 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.856452:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024a600/0x977d9e7969c0085a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c00853 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.856463:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024a600/0x977d9e7969c0085a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00853 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.856471:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a600, rc 0) 00000100:00100000:0.0:1788572256.856526:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c04a0e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518385920:12345-0@lo:101:mount.lustre.0 Request processed in 131us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.856533:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788572256.856586:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518385920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572256.856600:0:15764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c058a0d600/0x977d9e7969c00853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0085a expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.856609:0:15764:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c058a0d600/0x977d9e7969c00853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c0085a expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572256.860830:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788572256.861372:0:15764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572256.863372:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788572256.863455:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788572256.863656:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788572256.864061:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788572256.864100:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788572256.864145:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788572256.864177:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788572256.864209:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788572256.864283:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788572256.864320:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788572256.864368:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788572256.864418:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788572256.864466:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788572256.866144:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788572256.866218:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788572256.866285:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788572256.866322:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788572256.868653:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788572256.868915:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788572256.868955:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788572256.869003:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788572256.869040:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788572256.869072:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788572256.869132:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788572256.869169:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788572256.869202:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788572256.870967:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788572256.871047:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788572256.871080:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788572256.871145:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788572256.871182:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788572256.871218:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788572256.871275:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788572256.871327:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788572256.871377:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788572256.871424:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788572256.871472:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788572256.875340:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788572256.875373:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788572256.875647:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572256.875951:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572256.875994:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0515b3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572256.876237:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518386048 00000100:00100000:2.0:1788572256.876244:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518386048 00000100:00100000:2.0:1788572256.876321:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788572256.876331:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518386048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572256.876809:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518386048:12345-0@lo:501:mount.lustre.0 Request processed in 478us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572256.876817:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788572256.881686:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572256.881753:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572256.881821:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572256.881872:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0515b3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572256.882143:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518386176 00000100:00100000:2.0:1788572256.882150:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518386176 00000100:00100000:2.0:1788572256.882193:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788572256.882202:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518386176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572256.883284:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518386176:12345-0@lo:503:mount.lustre.0 Request processed in 1045us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572256.883294:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788572256.883642:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386176:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788572256.885431:0:15764:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572256.885784:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572256.885924:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572256.885967:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518386304 00000100:00100000:0.0:1788572256.885979:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518386304 00000100:00100000:0.0:1788572256.886028:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788572256.886036:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518386304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572256.886611:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518386304:12345-0@lo:502:mount.lustre.0 Request processed in 574us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.886619:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788572256.886815:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0515b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572256.886916:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572256.887173:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788572256.887226:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788572256.890143:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788572256.890286:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788572256.890331:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788572256.890396:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788572256.890432:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788572256.890492:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788572256.890546:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788572256.890583:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788572256.890619:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788572256.890677:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788572256.890725:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788572256.890761:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788572256.890811:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788572256.891297:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788572256.891337:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788572256.891386:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788572256.891421:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788572256.891468:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788572256.891532:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788572256.891566:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788572256.891608:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788572256.891650:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788572256.891702:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788572256.891732:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788572256.891775:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788572256.891809:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788572256.891852:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788572256.891892:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788572256.891922:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788572256.891965:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788572256.891995:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788572256.892038:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788572256.892074:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788572256.892117:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788572256.892151:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788572256.892183:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788572256.892230:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788572256.892288:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788572256.892338:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572256.892415:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572256.892473:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0515b3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572256.892562:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518386432 00000100:00100000:1.0:1788572256.892570:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518386432 00000100:00100000:1.0:1788572256.892622:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788572256.892633:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518386432:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572256.892873:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518386432:12345-0@lo:502:mount.lustre.0 Request processed in 241us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572256.892887:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788572256.893058:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386432:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572256.893126:0:15764:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788572256.893135:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788572256.897764:0:15775:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788572256.897795:0:15775:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88bf46070000) 00000020:00000080:3.0:1788572256.897818:0:15775:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788572256.897914:0:15775:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88bf4531a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788572256.897918:0:15775:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88bf4531a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788572256.897921:0:15775:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88bf4531a000 3 00010000:00080000:3.0:1788572256.897958:0:15775:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88c052a59000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1788572256.899642:0:15775:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788572256.899844:0:15775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788572256.899875:0:15775:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788572256.899889:0:15775:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x977d9e7969c00868 00000100:00080000:3.0:1788572256.899900:0:15775:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572256.899905:0:15775:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88c052a59000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572256.899948:0:15775:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bf476ba680 x1875453518386560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572256.899985:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518386560:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572256.900053:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572256.900115:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518386560 00000100:00100000:3.0:1788572256.900122:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518386560 00000100:00100000:3.0:1788572256.900152:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572256.900160:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3296:x1875453518386560:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788572256.900181:0:14362:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:3.0:1788572256.900207:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x977d9e7969c0086f 00000004:00100000:3.0:1788572256.900221:0:14362:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572256.900268:0:14362:0:(import.c:65:import_set_state_nolock()) ffff88c050023000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572256.900315:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875453518386560:12345-0@lo:38:llog_process_th.0 Request processed in 153us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572256.900322:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788572256.900361:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88bf476ba680 x1875453518386560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572256.900370:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572256.900377:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788572256.900383:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788572256.900387:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788572256.900389:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c052a59000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788572256.900394:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1875453518386560:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788572256.900409:0:15775:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1788572256.917199:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788572256.917409:0:15764:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788572256.917451:0:15764:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788572256.917474:0:15764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c058a0d600/0x977d9e7969c00853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0085a expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.917595:0:15764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c058a0d600/0x977d9e7969c00853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c0085a expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788572256.917710:0:15764:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788572256.917716:0:15764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788572256.917717:0:15764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572256.917718:0:15764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572256.917719:0:15764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572256.917720:0:15764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572256.917722:0:15764:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572256.917723:0:15764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572256.917724:0:15764:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572256.917728:0:15764:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788572256.917730:0:15764:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788572256.917731:0:15764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788572256.917732:0:15764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572256.917733:0:15764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572256.917735:0:15764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572256.917735:0:15764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572256.917736:0:15764:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572256.917737:0:15764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572256.917738:0:15764:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572256.917778:0:15764:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788572256.917798:0:15764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788572256.917876:0:15764:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572256.917913:0:15764:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572256.918105:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518386688 00000100:00100000:0.0:1788572256.918112:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518386688 00000100:00100000:0.0:1788572256.918158:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788572256.918167:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c413850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:15764:x1875453518386688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788572256.918192:0:14356:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788572256.918204:0:14356:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788572256.939379:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788572256.953059:0:14356:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788572256.953079:0:14356:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788572256.953201:0:14377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788572256.953207:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788572256.953228:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.953422:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00749 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.953433:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.953487:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c00749 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.953500:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c00749 expref: 19 pid: 14356 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572256.953516:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875453518386816:0@lo:104: 00000100:00100000:0.0:1788572256.953584:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572256.953632:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0515b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572256.953713:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518386816 00000100:00100000:3.0:1788572256.953720:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518386816 00000100:00100000:3.0:1788572256.953771:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788572256.953781:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:14377:x1875453518386816:12345-0@lo:104: 00010000:00010000:3.0:1788572256.953793:0:14345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572256.953844:0:14345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572256.953850:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:14377:x1875453518386816:12345-0@lo:104: Request processed in 71us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572256.953857:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788572256.954004:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572256.954010:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954023:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:0.0:1788572256.954027:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954035:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572256.954041:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572256.954047:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572256.954083:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954090:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572256.954118:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954125:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076995200/0x977d9e7969c00749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c00750 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954140:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572256.954142:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572256.954144:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572256.954151:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572256.954162:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07ba40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518386944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788572256.954203:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572256.954231:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518386944 00000100:00100000:0.0:1788572256.954234:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518386944 00010000:00010000:0.0:1788572256.954295:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00749 expref: 20 pid: 14356 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572256.954316:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572256.954322:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+20:3297:x1875453518386944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572256.954333:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572256.954337:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00749 expref: 20 pid: 14356 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954347:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c00749 expref: 20 pid: 14356 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954363:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954371:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788572256.954383:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001239931s 00010000:00010000:0.0:1788572256.954388:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954395:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954402:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954409:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954415:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572256.954425:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954433:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954459:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954470:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572256.954499:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+20:3297:x1875453518386944:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572256.954506:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572256.954554:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518386944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572256.954582:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387a00/0x977d9e7969c00750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c00749 expref: 19 pid: 14356 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572256.954593:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07ba42a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875453518386816:0@lo:104: 00010000:00010000:0.0:1788572256.954604:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954612:0:14377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954619:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572256.954625:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c05024b600/0x977d9e7969c00876 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572256.960218:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c413850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:15764:x1875453518386688:12345-0@lo:253:mount.lustre.0 Request processed in 42042us (42333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572256.960231:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788572256.960429:0:15764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf634c0e-dd8a-4982-ad2a-0f984621b961:15764:1875453518386688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788572256.960458:0:15764:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788572256.960461:0:15764:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788572256.960463:0:15764:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788572256.960464:0:15764:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572256.960465:0:15764:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572256.960467:0:15764:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572256.960468:0:15764:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572256.960469:0:15764:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572256.960471:0:15764:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572256.960472:0:15764:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788572256.960487:0:15764:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788572256.964653:0:15764:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788572256.964802:0:15764:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788572256.964927:0:15764:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788572256.965047:0:15764:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788572256.965163:0:15764:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788572256.965743:0:15764:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788572256.966975:0:15764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788572257.087687:0:15764:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788572257.087697:0:15764:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788572257.087739:0:15764:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788572257.087799:0:15764:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788572257.087813:0:15764:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788572257.087844:0:15764:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788572257.961777:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788572258.418639:0:14358:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572258.418648:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88bf452dd800 from 8 10000000:01000000:3.0:1788572258.418663:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572258.418712:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c0087d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572258.418724:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c0087d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572258.418738:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c0087d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572258.418766:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518387072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572258.418833:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572258.418883:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572258.419048:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518387072 00000100:00100000:2.0:1788572258.419057:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518387072 00000100:00100000:2.0:1788572258.419114:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788572258.419125:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:14358:x1875453518387072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572258.419149:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572258.419163:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0da00/0x977d9e7969c00884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c0087d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572258.419187:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0da00/0x977d9e7969c00884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c0087d expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572258.419198:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0da00/0x977d9e7969c00884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c0087d expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572258.419206:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0da00, rc 0) 00000100:00100000:2.0:1788572258.419270:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:14358:x1875453518387072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572258.419279:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788572258.419496:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518387072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572258.419512:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c0087d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00884 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572258.419522:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c0087d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00884 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572258.419583:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518387200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788572258.419612:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572258.419635:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0474e63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572258.419833:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518387200 00000100:00100000:2.0:1788572258.419838:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518387200 00000100:00100000:2.0:1788572258.419870:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788572258.419883:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:14358:x1875453518387200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788572258.419898:0:14356:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788572258.419913:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788572258.419916:0:14356:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788572258.419986:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:14358:x1875453518387200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572258.419993:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788572258.420582:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518387200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788572258.420639:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572258.420648:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c0087d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00884 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572258.420666:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c052e4c000/0x977d9e7969c0087d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00884 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572258.984393:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788572259.497202:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788572260.014159:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572261.032969:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572261.486654:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518387328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572261.486740:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572261.486863:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518387328 00000100:00100000:3.0:1788572261.486871:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518387328 00000100:00100000:3.0:1788572261.486929:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788572261.486938:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518387328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572261.486972:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572261.490325:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518387328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3377us (3574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572261.490339:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788572261.490379:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572261.500894:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518387328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572262.000088:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf634c0e-dd8a-4982-ad2a-0f984621b961:3300:1875453518387456:0@lo:400:kworker.0 00000100:00100000:1.0:1788572262.000160:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572262.000262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788572262.000266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788572262.000270:0:36:0:(import.c:65:import_set_state_nolock()) ffff88c0556c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572262.000276:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:3.0:1788572262.000285:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572262.000293:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88c0556c2000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788572262.000321:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88bf476b8380 x1875453518387584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572262.001792:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572262.001808:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518387968:0@lo:400:kworker.0 00000100:00100000:1.0:1788572262.001864:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572262.001911:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518387456 00000100:00100000:0.0:1788572262.001911:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518387968 00000100:00100000:1.0:1788572262.001918:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518387456 00000100:00100000:0.0:1788572262.001918:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518387968 00000100:00100000:1.0:1788572262.001959:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788572262.001959:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788572262.001968:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3300:x1875453518387456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572262.001968:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518387968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572262.002015:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3300:x1875453518387456:12345-0@lo:400:kworker.0 Request processed in 49us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572262.002022:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788572262.002159:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf634c0e-dd8a-4982-ad2a-0f984621b961:3300:1875453518387456:0@lo:400:kworker.0 00000100:00080000:1.0:1788572262.004422:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572262.004554:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518387584:0@lo:8:kworker.0 00000100:00100000:3.0:1788572262.004599:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572262.004645:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518387712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572262.004663:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875453518387968:12345-0@lo:400:kworker.0 Request processed in 2695us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572262.004669:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572262.004672:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788572262.004687:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572262.004692:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518387840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572262.004711:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518387712 00000100:00100000:0.0:1788572262.004720:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518387712 00000100:00100000:0.0:1788572262.004759:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788572262.004768:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518387712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572262.004792:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572262.004811:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875453518387712:12345-0@lo:400:kworker.0 Request processed in 44us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572262.004818:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788572262.004819:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518387584 00000100:00100000:3.0:1788572262.004822:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518387584 00000100:00100000:0.0:1788572262.004827:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518387840 00000100:00100000:0.0:1788572262.004829:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518387840 00000100:00100000:3.0:1788572262.004844:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572262.004849:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3296:x1875453518387584:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788572262.004849:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788572262.004854:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518387840:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788572262.004873:0:15044:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000100:00100000:0.0:1788572262.004877:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518387840:12345-0@lo:400:kworker.0 Request processed in 24us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572262.004883:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:00000080:3.0:1788572262.004900:0:15044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x977d9e7969c0088b 00000100:00080000:0.0:1788572262.004901:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00100000:3.0:1788572262.004913:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88bf47469800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788572262.004917:0:15044:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788572262.004920:0:15044:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788572262.006387:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788572262.006430:0:15044:0:(import.c:65:import_set_state_nolock()) ffff88bf4746d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572262.006503:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1875453518387584:12345-0@lo:8:kworker.0 Request processed in 1651us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572262.006510:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788572262.006573:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf476b8380 x1875453518387584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788572287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572262.006591:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572262.006600:0:3296:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788572262.006608:0:3296:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788572262.006613:0:3296:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788572262.006616:0:3296:0:(import.c:65:import_set_state_nolock()) ffff88c0556c2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788572262.006630:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788572262.006635:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1875453518387584:0@lo:8:kworker.0 00000004:00080000:3.0:1788572262.006661:0:14385:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1788572262.006974:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf476ba680 x1875453518387968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572262.006986:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1875453518387968:0@lo:400:kworker.0 00000004:00080000:1.0:1788572262.007038:0:14386:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788572262.007057:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14386:1875453518388224:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788572262.007218:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572262.007238:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c055557b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572262.007239:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518388224 00000100:00100000:2.0:1788572262.007245:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518388224 00000100:00100000:1.0:1788572262.007265:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572262.007278:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518388096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572262.007300:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572262.007302:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572262.007308:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14386:x1875453518388224:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788572262.007802:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518388096 00000100:00100000:1.0:1788572262.007807:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518388096 00000100:00100000:1.0:1788572262.007833:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788572262.007839:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518388096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572262.007861:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572262.007899:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1875453518388096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572262.007905:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788572262.007936:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf47695180 x1875453518388096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788572278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572262.007950:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518388096:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788572262.008240:0:14385:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 482798990677ns, next at 0ns, rc = 0 00010000:00080000:3.0:1788572262.008303:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf476bb800 x1875453518387840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572262.008780:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518387840:0@lo:400:kworker.0 00010000:00080000:3.0:1788572262.008797:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf476b9f80 x1875453518387712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572262.008804:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875453518387712:0@lo:400:kworker.0 00000100:00080000:3.0:1788572262.008842:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788572262.014294:0:15045:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788572262.014303:0:15045:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788572262.014309:0:15045:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788572262.045136:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788572262.050608:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050630:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788572262.050634:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572262.050641:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050667:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050690:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050711:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050760:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.050774:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.050780:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050789:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.050794:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050803:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050819:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050827:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fb29dca/0x977d9e7969c00892 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.050853:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.050861:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.050863:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572262.051530:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788572262.051537:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.051547:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788572262.051551:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572262.051556:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.051565:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.051573:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.051581:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.051605:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572262.051986:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788572262.051992:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052001:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788572262.052004:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572262.052008:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052024:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052032:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052040:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052059:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572262.052116:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572262.052123:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052131:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572262.052136:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052168:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052184:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052191:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dca3a974/0x977d9e7969c00899 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052209:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572262.052212:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052218:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:3.0:1788572262.052221:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052229:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052238:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052245:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcb47717/0x977d9e7969c008a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.052290:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572262.052292:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572262.052294:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572262.052441:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572262.052488:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788572262.052494:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052502:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788572262.052505:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572262.052509:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052518:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052526:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052543:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052556:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.052564:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.052568:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052575:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.052579:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052586:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052598:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052605:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c008a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052617:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.052618:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.052620:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572262.052977:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788572262.052990:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.052999:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788572262.053002:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572262.053006:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.053015:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.053024:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.053031:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.053052:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572262.053266:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572262.053271:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.053279:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572262.053282:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.053289:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.053301:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.053314:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c3a3d76/0x977d9e7969c008ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.053329:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572262.053331:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572262.053333:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572262.056870:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788572262.067538:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.067553:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.067570:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.067575:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.067581:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.067599:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.067625:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.067634:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.067689:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572262.068385:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.068403:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.068414:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.068418:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.068423:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.068433:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.068442:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.068450:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072757:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572262.072771:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072785:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ac00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572262.072790:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072802:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072823:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072830:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc86468e/0x977d9e7969c008b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072849:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572262.072853:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072867:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:1.0:1788572262.072870:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072878:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072888:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.072895:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572262.072897:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572262.072899:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.074335:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.074548:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572262.074560:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062cb39f0/0x977d9e7969c008bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572262.075360:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.075369:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.075384:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.075389:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.075407:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.075421:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.075431:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.075563:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.075996:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.076004:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.076012:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.076017:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.076039:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.076066:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.076077:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.076079:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.076081:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.076182:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572262.076189:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd5e442e/0x977d9e7969c008c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572262.077331:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.077340:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.077353:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.077357:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.077362:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.077373:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.077382:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.077389:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.077620:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.077627:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.077635:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.077638:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.077646:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.077660:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.077846:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572262.077851:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.078133:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572262.078429:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.078435:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.086374:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.086379:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.086387:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.086417:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.086430:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.086447:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.086472:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.089296:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.089311:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.089333:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.089338:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.089349:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.089369:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.089377:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c008d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.089412:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.089414:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.089416:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572262.091068:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.091082:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.091096:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.091101:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.091106:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.091120:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.091142:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.091150:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.091165:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.091930:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.091938:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.091948:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ba00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.091953:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.091962:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.091985:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.091993:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca8fdbe1/0x977d9e7969c008d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.092012:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.092014:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.092016:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572262.092959:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572262.092964:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572262.092966:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572262.093666:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.093676:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.094616:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.094626:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.094634:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.094651:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.094662:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.094671:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.094952:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788572262.095932:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.095942:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.095955:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.095959:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.095964:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.095975:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.095984:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.095991:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.097155:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572262.097166:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.097176:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.097182:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.097192:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.097211:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.097219:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002439fb10/0x977d9e7969c008df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.098195:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.098201:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.098212:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024be00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.098216:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.098225:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.098238:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.098245:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.098258:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.098261:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.098411:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572262.098418:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c008e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.098840:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572262.099684:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.099802:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.099823:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.099828:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.099833:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.099846:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.099855:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.099863:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.099887:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.100238:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.100245:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.100276:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.100280:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.100301:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.100317:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.100325:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a958b1f0/0x977d9e7969c008ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.100344:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.100346:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.100347:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572262.100877:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788572262.100885:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.100895:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=482s v=(0 0) 00010000:00010000:0.0:1788572262.100899:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572262.100903:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.100913:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.100934:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.100942:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.100957:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.101175:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.101181:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.101189:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.101192:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.101201:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.101214:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.101232:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945502ba/0x977d9e7969c008f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.101270:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.101273:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.101275:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572262.103979:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572262.103992:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.105638:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788572262.105644:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572262.105651:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.105671:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.105684:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.105699:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.105724:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572262.106340:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572262.106348:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106357:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788572262.106360:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572262.106365:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106374:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106382:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106389:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106415:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572262.106805:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572262.106811:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106827:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788572262.106830:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572262.106834:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106843:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106851:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106856:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.106863:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572262.107218:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572262.107223:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107231:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788572262.107234:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572262.107238:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107268:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107288:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107295:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107303:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788572262.107667:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572262.107673:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107682:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788572262.107685:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572262.107689:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107698:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107706:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107714:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.107732:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788572262.107953:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572262.107961:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.107969:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994c00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572262.107975:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.107985:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108003:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108011:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b39f1674/0x977d9e7969c008fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108027:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572262.108037:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108043:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572262.108046:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108053:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108063:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108069:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec836018/0x977d9e7969c00902 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108082:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572262.108085:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108091:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572262.108094:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108101:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108121:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108127:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4e5a477/0x977d9e7969c00909 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108138:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572262.108142:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108159:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572262.108163:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108171:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108181:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108187:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008afd9c60/0x977d9e7969c00910 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108197:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572262.108200:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108211:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995800 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572262.108214:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108221:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108230:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108237:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041e3c07b/0x977d9e7969c00917 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572262.108265:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.108267:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572262.108269:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572262.108738:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572262.118877:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572262.118890:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.118907:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788572262.118911:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572262.118918:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.118933:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.118943:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.118951:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.118967:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.126627:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.126642:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.126656:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.126661:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.126673:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.126707:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.126820:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b669f2d0/0x977d9e7969c0091e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.126850:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.126852:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.126854:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572262.134289:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788572262.134301:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.134317:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788572262.134329:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572262.134336:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.134352:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.134363:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.134372:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572262.134402:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.134830:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.134838:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.134846:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994400 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.134850:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.134859:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.134876:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.134883:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005016f557/0x977d9e7969c00925 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.134903:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.134905:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.134907:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572262.143608:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788572262.143690:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143825:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788572262.143831:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572262.143837:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143864:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143875:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143884:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143903:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.143918:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.143924:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143932:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.143937:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143946:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143961:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143969:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee485e1f/0x977d9e7969c0092c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.143992:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.144582:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.144585:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572262.146496:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572262.146508:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.146525:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1788572262.146530:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572262.146537:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.146550:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.146561:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.146569:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.146596:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.146787:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.146795:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.146803:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4ce00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.146808:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.146817:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.146833:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.146841:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e39e6b0/0x977d9e7969c00933 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.146861:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.146863:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.146865:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572262.146984:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572262.146990:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.146997:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1788572262.147001:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572262.147004:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147013:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147020:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147028:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147048:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.147063:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.147068:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147086:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d200 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.147089:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147097:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147108:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147115:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b97527f/0x977d9e7969c0093a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147127:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.147129:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.147131:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572262.147491:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572262.147497:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147504:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1788572262.147507:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572262.147511:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147532:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147540:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147547:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147561:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.147783:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.147788:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147795:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4de00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.147798:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147805:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147822:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147830:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d60a0c54/0x977d9e7969c00941 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.147844:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.147846:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.147848:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572262.147931:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572262.147936:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147944:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1788572262.147947:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572262.147951:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147960:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147968:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.147986:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.148003:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.148269:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.148274:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.148281:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d000 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.148285:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.148293:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.148304:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.148312:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079ca412a/0x977d9e7969c00948 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.148334:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.148336:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.148338:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572262.148379:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788572262.148385:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.156658:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1788572262.156668:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572262.156677:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.156693:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.156762:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.156769:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572262.156788:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572262.156815:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572262.156823:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.156831:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4da00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572262.156835:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.156844:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.156860:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.156867:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008037a95/0x977d9e7969c0094f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572262.156886:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.156887:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572262.156889:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788572262.157137:0:15045:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1788572262.158036:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14386:x1875453518388224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 150723us (150812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572262.158055:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788572262.158571:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14386:1875453518388224:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788572262.158588:0:14386:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788572262.158646:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14386:1875453518388352:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788572262.158690:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572262.158866:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572262.159527:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518388352 00000100:00100000:3.0:1788572262.159536:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518388352 00000100:00100000:3.0:1788572262.159582:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788572262.159592:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14386:x1875453518388352:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788572262.159657:0:15043:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788572262.191485:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14386:x1875453518388352:12345-0@lo:5:osp-pre-1-0.0 Request processed in 31889us (32788us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788572262.191498:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788572262.192596:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14386:1875453518388352:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788572262.192615:0:14386:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788572263.081768:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572264.109055:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572265.129677:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572266.126167:0:16123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788572266.154377:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572266.600563:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518388480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572266.600634:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572266.604987:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518388480 00000100:00100000:1.0:1788572266.605005:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518388480 00000100:00100000:1.0:1788572266.605084:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572266.605096:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518388480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572266.605139:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572266.605219:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518388480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (4585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572266.605226:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572266.605293:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518388480:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788572266.608071:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572267.127692:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf634c0e-dd8a-4982-ad2a-0f984621b961:3298:1875453518388608:0@lo:400:kworker.0 00000100:00100000:1.0:1788572267.130277:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572267.131508:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518388608 00000100:00100000:3.0:1788572267.131519:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518388608 00000100:00100000:3.0:1788572267.131577:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788572267.131586:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c413c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3298:x1875453518388608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572267.131650:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c413c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3298:x1875453518388608:12345-0@lo:400:kworker.0 Request processed in 65us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572267.131658:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788572267.132561:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518389120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572267.132617:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572267.132672:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf634c0e-dd8a-4982-ad2a-0f984621b961:3298:1875453518388608:0@lo:400:kworker.0 00000100:00100000:1.0:1788572267.132692:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572267.132701:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518388992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572267.134528:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518388864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572267.134597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572267.134636:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572267.134642:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518388736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572267.134669:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572267.134697:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf476b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518389248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572267.134828:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572267.135268:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518389120 00000100:00100000:0.0:1788572267.135277:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518389120 00000100:00100000:0.0:1788572267.135332:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518388864 00000100:00100000:0.0:1788572267.135336:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518388864 00000100:00100000:0.0:1788572267.135347:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518388992 00000100:00100000:0.0:1788572267.135363:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518388992 00000100:00100000:0.0:1788572267.135381:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788572267.135389:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518389120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572267.136144:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572267.136158:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518388864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572267.136227:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875453518388864:12345-0@lo:400:kworker.0 Request processed in 74us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572267.136234:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572267.136270:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788572267.136277:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518388992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572267.136328:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518388992:12345-0@lo:400:kworker.0 Request processed in 51us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572267.136333:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572267.137536:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875453518389120:12345-0@lo:400:kworker.0 Request processed in 2142us (4914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572267.137564:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788572267.139240:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788572267.139319:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf47694700 x1875453518388864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572267.139335:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875453518388864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572267.139407:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518388736 00000100:00100000:3.0:1788572267.139413:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518388736 00000100:00100000:3.0:1788572267.139465:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572267.139474:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1875453518388736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572267.139524:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3300:x1875453518388736:12345-0@lo:400:kworker.0 Request processed in 52us (4854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572267.139532:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788572267.139552:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572267.139556:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572267.139569:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518389248 00000100:00100000:3.0:1788572267.139573:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518389248 00000100:00100000:3.0:1788572267.139597:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572267.139604:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875453518389248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572267.139628:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572267.139659:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875453518389248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572267.139664:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572267.139691:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518388736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572267.139705:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf476b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518389248:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788572267.140624:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf47694e00 x1875453518388992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572267.140637:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518388992:0@lo:400:kworker.0 00010000:00080000:1.0:1788572267.140651:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88bf47696300 x1875453518389120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788572283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572267.140660:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1875453518389120:0@lo:400:kworker.0 00010000:00010000:2.0:1788572267.178631:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788572267.372473:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788572267.372495:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788572268.200811:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572268.959196:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572268.959504:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495321600 00000100:00100000:1.0:1788572268.959513:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495321600 00000100:00100000:1.0:1788572268.959561:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:1.0:1788572268.959580:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c412c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1875453495321600:12345-192.168.202.2@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788572268.959611:0:14356:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 521ca3eb-db2d-45f5-993b-8b7ccd79f40d@192.168.202.2@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1788572268.959641:0:14356:0:(genops.c:1385:class_connect()) connect: client 521ca3eb-db2d-45f5-993b-8b7ccd79f40d, cookie 0x977d9e7969c00956 00000100:00080000:1.0:1788572268.959772:0:14356:0:(import.c:65:import_set_state_nolock()) ffff88c0513c1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572268.959848:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c412c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+5:2352:x1875453495321600:12345-192.168.202.2@tcp:250:mount.lustre.0 Request processed in 268us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572268.959856:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:2.0:1788572268.982165:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572268.982283:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495321728 00000100:00100000:3.0:1788572268.982303:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495321728 00000100:00100000:3.0:1788572268.982368:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:3.0:1788572268.982385:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+5:13781:x1875453495321728:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788572268.982401:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572268.982419:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c052e4d400/0x977d9e7969c0095d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1120a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572268.982449:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c052e4d400/0x977d9e7969c0095d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1120a expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572268.982461:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c052e4d400/0x977d9e7969c0095d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1120a expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572268.982470:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4d400, rc 0) 00000100:00100000:3.0:1788572268.982527:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+6:13781:x1875453495321728:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 151us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572268.982534:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:0.0:1788572268.985303:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572268.985399:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495321856 00000100:00100000:3.0:1788572268.985407:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495321856 00000100:00100000:3.0:1788572268.985454:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:3.0:1788572268.985464:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07c410c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+6:13781:x1875453495321856:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788572268.985744:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07c410c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+6:13781:x1875453495321856:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 280us (447us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572268.985752:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:2.0:1788572268.998438:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572268.998597:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495321984 00000100:00100000:1.0:1788572268.998625:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495321984 00000100:00100000:1.0:1788572268.998700:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:1.0:1788572268.998712:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+6:13781:x1875453495321984:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788572268.998729:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572268.998749:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076994400/0x977d9e7969c00964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11211 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572268.998781:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076994400/0x977d9e7969c00964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11211 expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572268.998793:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076994400/0x977d9e7969c00964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11211 expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572268.998802:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994400, rc 0) 00000100:00100000:1.0:1788572268.998867:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+7:13781:x1875453495321984:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 157us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572268.998875:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:2.0:1788572269.006765:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572269.010515:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495322112 00000100:00100000:1.0:1788572269.010534:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495322112 00000100:00100000:1.0:1788572269.010611:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:1.0:1788572269.010624:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+7:13781:x1875453495322112:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788572269.010941:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+8:13781:x1875453495322112:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 319us (4188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572269.010950:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:0.0:1788572269.016191:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572269.017297:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495322240 00000100:00100000:3.0:1788572269.017310:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495322240 00000100:00100000:3.0:1788572269.017395:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:3.0:1788572269.017406:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+8:13781:x1875453495322240:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788572269.018546:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+8:13781:x1875453495322240:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 1132us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572269.018567:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:2.0:1788572269.027442:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572269.027732:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495322368 00000100:00100000:1.0:1788572269.027742:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495322368 00000100:00100000:1.0:1788572269.027809:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:1.0:1788572269.027820:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+8:13800:x1875453495322368:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788572269.028166:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+8:13800:x1875453495322368:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 348us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572269.028174:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:2.0:1788572269.042346:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572269.042552:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495322496 00000100:00100000:3.0:1788572269.042563:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495322496 00000100:00100000:3.0:1788572269.042635:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:3.0:1788572269.042647:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+8:13800:x1875453495322496:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788572269.042946:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+8:13800:x1875453495322496:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 300us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572269.042954:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:0.0:1788572269.052174:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572269.052714:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495322624 00000100:00100000:2.0:1788572269.052725:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495322624 00000100:00100000:2.0:1788572269.052780:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:2.0:1788572269.052791:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+8:13781:x1875453495322624:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788572269.052808:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572269.052847:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c058a0de00/0x977d9e7969c0096b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1123b expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572269.052875:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c058a0de00/0x977d9e7969c0096b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1123b expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572269.052887:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c058a0de00/0x977d9e7969c0096b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1123b expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572269.052898:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0de00, rc 0) 00000100:00100000:2.0:1788572269.052960:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+9:13781:x1875453495322624:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 172us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572269.052968:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:2.0:1788572269.063593:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572269.063685:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495322752 00000100:00100000:1.0:1788572269.063694:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495322752 00000100:00100000:1.0:1788572269.063747:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:1.0:1788572269.063757:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+9:13781:x1875453495322752:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788572269.063781:0:14353:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788572269.063805:0:14353:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788572269.063809:0:14353:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788572269.063813:0:14353:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788572269.063815:0:14353:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788572269.070698:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+9:13781:x1875453495322752:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 6931us (7103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572269.070714:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:0.0:1788572269.079587:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572269.079729:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495322880 00000100:00100000:3.0:1788572269.079739:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495322880 00000100:00100000:3.0:1788572269.079797:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:3.0:1788572269.079808:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+9:13781:x1875453495322880:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788572269.079836:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572269.079865:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11242 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572269.079896:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11242 expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572269.079909:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11242 expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572269.079939:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4d600, rc 0) 00000100:00100000:3.0:1788572269.080009:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13781:x1875453495322880:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 202us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572269.080017:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:2.0:1788572269.085611:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572269.085755:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495323008 00000100:00100000:3.0:1788572269.085765:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495323008 00000100:00100000:3.0:1788572269.085836:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1788572269.085855:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13781:x1875453495323008:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788572269.086415:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13781:x1875453495323008:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 559us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572269.086424:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:1.0:1788572269.104197:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572269.104659:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495323136 00000100:00100000:2.0:1788572269.104670:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495323136 00000100:00100000:2.0:1788572269.104742:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:2.0:1788572269.104752:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13781:x1875453495323136:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788572269.105079:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13781:x1875453495323136:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 327us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572269.105088:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:1.0:1788572269.111730:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572269.112387:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495323264 00000100:00100000:0.0:1788572269.112399:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495323264 00000100:00100000:0.0:1788572269.112460:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:0.0:1788572269.112471:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13806:x1875453495323264:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788572269.112784:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13806:x1875453495323264:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 314us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572269.112792:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:1.0:1788572269.119102:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572269.119404:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495323392 00000100:00100000:2.0:1788572269.119415:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495323392 00000100:00100000:2.0:1788572269.119480:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:2.0:1788572269.119491:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13806:x1875453495323392:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788572269.119767:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13806:x1875453495323392:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 277us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572269.119775:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:1.0:1788572269.141724:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572269.142051:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495323520 00000100:00100000:2.0:1788572269.142060:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495323520 00000100:00100000:2.0:1788572269.142120:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:2.0:1788572269.142128:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875453495323520:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788572269.142165:0:14361:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 49879c47-62cc-4834-ba47-ea0cc39dfd63@192.168.202.2@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1788572269.142215:0:14361:0:(genops.c:1385:class_connect()) connect: client 49879c47-62cc-4834-ba47-ea0cc39dfd63, cookie 0x977d9e7969c00979 00000004:00100000:2.0:1788572269.142243:0:14361:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788572269.142286:0:14361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788572269.225577:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572269.253696:0:14361:0:(import.c:65:import_set_state_nolock()) ffff88c0513c1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572269.253784:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:2352:x1875453495323520:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 111654us (112070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572269.253795:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788572269.256946:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572269.257036:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495323776 00000100:00100000:3.0:1788572269.257047:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495323776 00000100:00100000:3.0:1788572269.257127:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788572269.257137:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:13781:x1875453495323776:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788572269.257178:0:15283:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788572269.257296:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:13781:x1875453495323776:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 159us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572269.257303:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00080000:0.0:1788572269.257390:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572269.277368:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572269.277643:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572269.287515:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495323904 00000100:00100000:2.0:1788572269.287531:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495323904 00000100:00100000:2.0:1788572269.288153:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495323648 00000100:00100000:2.0:1788572269.288158:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495323648 00000100:00100000:1.0:1788572269.288265:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788572269.288282:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:13781:x1875453495323904:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788572269.288408:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:13781:x1875453495323904:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 131us (11163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572269.288415:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788572269.288435:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572269.288456:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:0:x1875453495323648:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788572269.288472:0:14361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788572269.288507:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:0:x1875453495323648:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 52us (10865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572269.288514:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572269.302845:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572269.302890:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572269.303030:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495324032 00000100:00100000:0.0:1788572269.303041:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495324032 00000100:00100000:0.0:1788572269.303086:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495324160 00000100:00100000:0.0:1788572269.303090:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495324160 00000100:00100000:0.0:1788572269.303103:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1788572269.303111:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875453495324032:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788572269.303144:0:15045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 49879c47-62cc-4834-ba47-ea0cc39dfd63@192.168.202.2@tcp t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:0.0:1788572269.303179:0:15045:0:(genops.c:1385:class_connect()) connect: client 49879c47-62cc-4834-ba47-ea0cc39dfd63, cookie 0x977d9e7969c00980 00002000:00100000:0.0:1788572269.303192:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 49879c47-62cc-4834-ba47-ea0cc39dfd63/ffff88c07b6d1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572269.303229:0:15045:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572269.303735:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788572269.303770:0:15045:0:(import.c:65:import_set_state_nolock()) ffff88c07b6d0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572269.304213:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:2352:x1875453495324032:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 1100us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572269.304222:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1788572269.304276:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788572269.304284:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875453495324160:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788572269.304306:0:15045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 49879c47-62cc-4834-ba47-ea0cc39dfd63@192.168.202.2@tcp t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:0.0:1788572269.304327:0:15045:0:(genops.c:1385:class_connect()) connect: client 49879c47-62cc-4834-ba47-ea0cc39dfd63, cookie 0x977d9e7969c00987 00002000:00100000:0.0:1788572269.304344:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 49879c47-62cc-4834-ba47-ea0cc39dfd63/ffff88c07b6d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572269.304361:0:15045:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572269.304655:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788572269.304675:0:15045:0:(import.c:65:import_set_state_nolock()) ffff88c07b6d3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572269.304705:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:2352:x1875453495324160:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 421us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572269.304712:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788572269.308155:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572269.308450:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495324288 00000100:00100000:3.0:1788572269.308460:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495324288 00000100:00100000:3.0:1788572269.308566:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1788572269.308579:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:13781:x1875453495324288:12345-192.168.202.2@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788572269.311546:0:14364:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2901us 00000004:00200000:1.0:1788572269.363459:0:14364:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788572269.363587:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:13781:x1875453495324288:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 55005us (55434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572269.363603:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788572269.642939:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572269.643037:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495324416 00000100:00100000:3.0:1788572269.643046:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495324416 00000100:00100000:3.0:1788572269.643105:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788572269.643115:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:13827:x1875453495324416:12345-192.168.202.2@tcp:101:mkdir.0 00010000:00010000:3.0:1788572269.643156:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572269.643183:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ca00/0x977d9e7969c0098e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1126c expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572269.643276:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4cc00/0x977d9e7969c00995 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572269.643290:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4cc00/0x977d9e7969c00995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572269.643303:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4cc00/0x977d9e7969c00995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572269.643349:0:15283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572269.643353:0:15283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572269.643394:0:15283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4cc00/0x977d9e7969c00995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572269.643417:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ca00/0x977d9e7969c0098e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1126c expref: 8 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572269.643435:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4cc00/0x977d9e7969c00995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1126c expref: 7 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572269.643443:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907700) 00010000:00010000:3.0:1788572269.643457:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572269.643460:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4cc00, rc 0) 00000100:00100000:3.0:1788572269.643521:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:13827:x1875453495324416:12345-192.168.202.2@tcp:101:mkdir.0 Request processed in 407us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572269.643527:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000040:00080000:3.0:1788572269.738727:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788572270.253880:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572271.273904:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572271.621034:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572271.621186:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495324544 00000100:00100000:2.0:1788572271.621197:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495324544 00000100:00100000:2.0:1788572271.621326:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1788572271.621336:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:13880:x1875453495324544:12345-192.168.202.2@tcp:41:lfs.0 00000004:00000024:2.0:1788572271.621373:0:14363:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788572271.621454:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:13880:x1875453495324544:12345-192.168.202.2@tcp:41:lfs.0 Request processed in 121us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572271.621459:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:0.0:1788572271.623106:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572271.629795:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572271.631150:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495324672 00000100:00100000:3.0:1788572271.631162:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495324672 00000100:00100000:3.0:1788572271.631291:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1788572271.631301:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:13880:x1875453495324672:12345-192.168.202.2@tcp:13:lfs.0 00002000:00000024:3.0:1788572271.631377:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572271.631464:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:13880:x1875453495324672:12345-192.168.202.2@tcp:13:lfs.0 Request processed in 164us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572271.631471:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00080000:0.0:1788572271.632118:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572271.634460:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572271.637681:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495324800 00000100:00100000:1.0:1788572271.637695:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495324800 00000100:00100000:1.0:1788572271.637854:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572271.637865:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:13880:x1875453495324800:12345-192.168.202.2@tcp:13:lfs.0 00002000:00000024:1.0:1788572271.638815:0:15046:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788572271.638941:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:13880:x1875453495324800:12345-192.168.202.2@tcp:13:lfs.0 Request processed in 1075us (4486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572271.638949:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00080000:0.0:1788572271.639987:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572271.720726:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518389376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572271.720792:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572271.720981:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518389376 00000100:00100000:0.0:1788572271.720990:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518389376 00000100:00100000:0.0:1788572271.721055:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788572271.721064:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518389376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572271.721103:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572271.721153:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518389376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.721160:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788572271.721205:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518389376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788572271.721414:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572271.864502:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572271.864576:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495324928 00000100:00100000:1.0:1788572271.864588:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495324928 00000100:00100000:1.0:1788572271.864654:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:1.0:1788572271.864665:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+10:13915:x1875453495324928:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788572271.864684:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572271.864717:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076994c00/0x977d9e7969c0099c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11273 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572271.864749:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076994c00/0x977d9e7969c0099c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11273 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572271.864762:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076994c00/0x977d9e7969c0099c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11273 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572271.864772:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994c00, rc 0) 00000100:00100000:1.0:1788572271.864829:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13915:x1875453495324928:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 166us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572271.864836:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:2.0:1788572271.870456:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572271.870753:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495325056 00000100:00100000:1.0:1788572271.870763:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495325056 00000100:00100000:1.0:1788572271.870817:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:1.0:1788572271.870827:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13915:x1875453495325056:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788572271.871332:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13915:x1875453495325056:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 505us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572271.871340:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:3.0:1788572271.878754:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572271.879104:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495325184 00000100:00100000:1.0:1788572271.879114:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495325184 00000100:00100000:1.0:1788572271.879173:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:1.0:1788572271.879184:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07646d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13915:x1875453495325184:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788572271.879470:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07646d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13915:x1875453495325184:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 287us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572271.879477:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:3.0:1788572271.889020:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572271.889113:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495325312 00000100:00100000:1.0:1788572271.889123:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495325312 00000100:00100000:0.0:1788572271.889811:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:0.0:1788572271.889822:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13919:x1875453495325312:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788572271.890199:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13919:x1875453495325312:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 378us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.890208:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:2.0:1788572271.910447:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572271.910548:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495325440 00000100:00100000:3.0:1788572271.910559:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495325440 00000100:00100000:3.0:1788572271.910737:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:3.0:1788572271.910749:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13919:x1875453495325440:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788572271.911123:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13919:x1875453495325440:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 375us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572271.911138:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:3.0:1788572271.918934:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572271.919280:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495325568 00000100:00100000:0.0:1788572271.919290:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495325568 00000100:00100000:0.0:1788572271.919349:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:0.0:1788572271.919358:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13915:x1875453495325568:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788572271.919374:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572271.919392:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024a200/0x977d9e7969c009a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1129d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572271.919422:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024a200/0x977d9e7969c009a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1129d expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572271.919433:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024a200/0x977d9e7969c009a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1129d expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572271.919442:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a200, rc 0) 00000100:00100000:0.0:1788572271.919502:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13915:x1875453495325568:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 145us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.919521:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:0.0:1788572271.926775:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572271.926978:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495325696 00000100:00100000:1.0:1788572271.926993:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495325696 00000100:00100000:1.0:1788572271.927468:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:1.0:1788572271.927481:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13915:x1875453495325696:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788572271.927511:0:14356:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788572271.927538:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788572271.927542:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788572271.927545:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788572271.927548:0:14356:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788572271.928888:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13915:x1875453495325696:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 1403us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572271.928901:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:2.0:1788572271.932880:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572271.933069:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495325824 00000100:00100000:3.0:1788572271.933079:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495325824 00000100:00100000:0.0:1788572271.933383:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:0.0:1788572271.933396:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13915:x1875453495325824:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788572271.933414:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572271.933435:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb112a4 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572271.933464:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112a4 expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572271.933475:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112a4 expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572271.933483:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ba00, rc 0) 00000100:00100000:0.0:1788572271.933635:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13915:x1875453495325824:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 242us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.933643:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:0.0:1788572271.936661:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572271.936773:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495325952 00000100:00100000:1.0:1788572271.936781:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495325952 00000100:00100000:1.0:1788572271.936868:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:1.0:1788572271.936879:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13915:x1875453495325952:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788572271.937285:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13915:x1875453495325952:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 407us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572271.937293:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:2.0:1788572271.941857:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572271.941969:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495326080 00000100:00100000:0.0:1788572271.941980:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495326080 00000100:00100000:0.0:1788572271.942161:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:0.0:1788572271.942172:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13915:x1875453495326080:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788572271.942464:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13915:x1875453495326080:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 293us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.942472:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:2.0:1788572271.949573:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572271.949734:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495326208 00000100:00100000:1.0:1788572271.949745:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495326208 00000100:00100000:1.0:1788572271.949842:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:1.0:1788572271.949853:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13924:x1875453495326208:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788572271.950294:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13924:x1875453495326208:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 442us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572271.950323:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:1.0:1788572271.955778:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572271.956107:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495326336 00000100:00100000:0.0:1788572271.956117:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495326336 00000100:00100000:0.0:1788572271.956181:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:0.0:1788572271.956192:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13924:x1875453495326336:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788572271.956469:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13924:x1875453495326336:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 278us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.956476:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:2.0:1788572271.965922:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572271.966123:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495326464 00000100:00100000:3.0:1788572271.966133:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495326464 00000100:00100000:3.0:1788572271.966192:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:3.0:1788572271.966201:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1875453495326464:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788572271.966232:0:15283:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from db5b294e-3ec6-4d91-9e97-6404d5f30cf6@192.168.202.2@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:3.0:1788572271.966295:0:15283:0:(genops.c:1385:class_connect()) connect: client db5b294e-3ec6-4d91-9e97-6404d5f30cf6, cookie 0x977d9e7969c009b1 00000004:00100000:3.0:1788572271.966336:0:15283:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788572271.966531:0:15283:0:(import.c:65:import_set_state_nolock()) ffff88c07b5ec000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572271.967031:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:2352:x1875453495326464:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 828us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572271.967040:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1788572271.973388:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572271.973432:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572271.975576:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495326720 00000100:00100000:0.0:1788572271.975593:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495326720 00000100:00100000:0.0:1788572271.975789:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495326592 00000100:00100000:0.0:1788572271.975793:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495326592 00000100:00100000:0.0:1788572271.975823:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788572271.975832:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+7:13915:x1875453495326720:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788572271.975873:0:14363:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788572271.975946:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+7:13915:x1875453495326720:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 115us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.975954:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788572271.975974:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1788572271.975980:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:0:x1875453495326592:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788572271.975990:0:14363:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788572271.976010:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:0:x1875453495326592:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 30us (2577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.976017:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00080000:3.0:1788572271.980725:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572271.981102:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572271.981287:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495326848 00000100:00100000:2.0:1788572271.981297:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495326848 00000100:00100000:2.0:1788572271.981371:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788572271.981381:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:13915:x1875453495326848:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788572271.981467:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:13915:x1875453495326848:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 86us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572271.981474:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788572271.984487:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572271.984590:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572271.984628:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572271.984710:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495326976 00000100:00100000:0.0:1788572271.984720:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495326976 00000100:00100000:0.0:1788572271.984777:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495327104 00000100:00100000:0.0:1788572271.984781:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495327104 00000100:00100000:0.0:1788572271.984806:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788572271.984813:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875453495326976:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788572271.984845:0:15043:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from db5b294e-3ec6-4d91-9e97-6404d5f30cf6@192.168.202.2@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1788572271.984890:0:15043:0:(genops.c:1385:class_connect()) connect: client db5b294e-3ec6-4d91-9e97-6404d5f30cf6, cookie 0x977d9e7969c009b8 00002000:00100000:0.0:1788572271.984903:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli db5b294e-3ec6-4d91-9e97-6404d5f30cf6/ffff88c07b6d6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572271.984914:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572271.985033:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788572271.985063:0:15043:0:(import.c:65:import_set_state_nolock()) ffff88c07b6d0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572271.985136:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:2352:x1875453495326976:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 316us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.985145:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788572271.985165:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788572271.985365:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875453495327104:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788572271.985385:0:15043:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from db5b294e-3ec6-4d91-9e97-6404d5f30cf6@192.168.202.2@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1788572271.985404:0:15043:0:(genops.c:1385:class_connect()) connect: client db5b294e-3ec6-4d91-9e97-6404d5f30cf6, cookie 0x977d9e7969c009bf 00002000:00100000:0.0:1788572271.985409:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli db5b294e-3ec6-4d91-9e97-6404d5f30cf6/ffff88c07b6d2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572271.985416:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572271.985470:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788572271.985486:0:15043:0:(import.c:65:import_set_state_nolock()) ffff88c07b6d5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572271.985511:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:2352:x1875453495327104:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 146us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572271.985518:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1788572271.986753:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495327232 00000100:00100000:1.0:1788572271.986763:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495327232 00000100:00100000:1.0:1788572271.986901:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1788572271.986911:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:13915:x1875453495327232:12345-192.168.202.2@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788572271.986974:0:14365:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788572271.987043:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:13915:x1875453495327232:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 134us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572271.987050:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:2.0:1788572272.161098:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572272.161203:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495327360 00000100:00100000:3.0:1788572272.161213:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495327360 00000100:00100000:3.0:1788572272.161296:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788572272.161319:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:13945:x1875453495327360:12345-192.168.202.2@tcp:101:mkdir.0 00010000:00010000:3.0:1788572272.161338:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572272.161367:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ca00/0x977d9e7969c009c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb112ce expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572272.161432:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572272.161463:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572272.161475:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572272.161514:0:15283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572272.161518:0:15283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572272.161551:0:15283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572272.161580:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ca00/0x977d9e7969c009c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ce expref: 8 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572272.161602:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ce expref: 7 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572272.161611:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907700) 00010000:00010000:3.0:1788572272.161614:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572272.161617:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4dc00, rc 0) 00000100:00100000:3.0:1788572272.161686:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+7:13945:x1875453495327360:12345-192.168.202.2@tcp:101:mkdir.0 Request processed in 381us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572272.161694:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788572272.232581:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572272.232606:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518389504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572272.232674:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572272.233590:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.233629:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572272.233652:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572272.233657:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518389632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.233698:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572272.233718:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.233737:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572272.233762:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518390016 00000100:00100000:3.0:1788572272.233769:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518390016 00000100:00100000:3.0:1788572272.233816:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518390144 00000100:00100000:3.0:1788572272.233820:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518390144 00000100:00100000:3.0:1788572272.233844:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788572272.233852:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518390016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.233901:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875453518390016:12345-0@lo:400:kworker.0 Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572272.233908:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788572272.233924:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788572272.233931:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518390144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.233958:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518390144:12345-0@lo:400:kworker.0 Request processed in 28us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572272.233964:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788572272.233981:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518389760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.234006:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572272.234024:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572272.234028:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518389888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.234047:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572272.234088:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.234099:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1875453518390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.234124:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518389888 00000100:00100000:3.0:1788572272.234133:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518389888 00000100:00100000:3.0:1788572272.234152:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788572272.234158:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518389888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572272.234190:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518389888:12345-0@lo:400:kworker.0 Request processed in 32us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572272.234197:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788572272.234223:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518389888:0@lo:400:kworker.0 00000100:00100000:1.0:1788572272.235334:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518389632 00000100:00100000:1.0:1788572272.235341:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518389632 00000100:00080000:2.0:1788572272.235641:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572272.235852:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518389504 00000100:00100000:0.0:1788572272.235857:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518389504 00000100:00100000:0.0:1788572272.235899:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788572272.235906:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518389504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572272.235926:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572272.235982:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518389504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (3308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572272.235988:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788572272.236008:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572272.236028:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788572272.236045:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518389504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572272.236068:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518389760 00000100:00100000:0.0:1788572272.236071:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518389760 00000100:00100000:0.0:1788572272.236093:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572272.236099:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518389760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572272.236130:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518389760:12345-0@lo:400:kworker.0 Request processed in 31us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572272.236135:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788572272.236162:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518389760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572272.254590:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788572272.254604:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3297:x1875453518389632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572272.254714:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3297:x1875453518389632:12345-0@lo:400:kworker.0 Request processed in 114us (21015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572272.254721:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788572272.254963:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518389632:0@lo:400:kworker.0 00010000:00010000:3.0:1788572272.296576:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788572272.298279:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db5b294e-3ec6-4d91-9e97-6404d5f30cf6 00000001:00100000:0.0:1788572272.298298:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49879c47-62cc-4834-ba47-ea0cc39dfd63 00000001:00100000:0.0:1788572273.291973:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db5b294e-3ec6-4d91-9e97-6404d5f30cf6 00000001:00100000:0.0:1788572273.292114:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49879c47-62cc-4834-ba47-ea0cc39dfd63 00010000:00010000:0.0:1788572273.321134:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788572274.340833:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49879c47-62cc-4834-ba47-ea0cc39dfd63 00000001:00100000:0.0:1788572274.340850:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of db5b294e-3ec6-4d91-9e97-6404d5f30cf6 00010000:00010000:2.0:1788572274.351166:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788572274.775782:0:16327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788572275.368967:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572276.393738:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572276.854838:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572276.854864:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518390272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572276.854940:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572276.855305:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518390272 00000100:00100000:3.0:1788572276.855314:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518390272 00000100:00100000:3.0:1788572276.855382:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788572276.855394:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518390272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572276.855441:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572276.855505:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518390272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572276.855513:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788572276.855554:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518390272:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788572276.855621:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572277.079127:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572277.079175:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572277.079206:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572277.079238:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572277.079314:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572277.079332:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572277.079356:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572277.079378:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495327744 00000100:00100000:0.0:1788572277.079387:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495327744 00000100:00100000:0.0:1788572277.079452:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495328256 00000100:00100000:0.0:1788572277.079456:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495328256 00000100:00100000:0.0:1788572277.079469:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495327872 00000100:00100000:0.0:1788572277.079472:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495327872 00000100:00100000:0.0:1788572277.079484:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495328128 00000100:00100000:0.0:1788572277.079486:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495328128 00000100:00100000:0.0:1788572277.079530:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1788572277.079540:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2354:x1875453495327744:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572277.079611:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2354:x1875453495327744:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 72us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572277.079618:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1788572277.079637:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788572277.079644:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2354:x1875453495328256:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572277.079668:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2354:x1875453495328256:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572277.079674:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788572277.079703:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788572277.079708:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2354:x1875453495327872:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572277.079729:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2354:x1875453495327872:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572277.079735:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788572277.079744:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:0.0:1788572277.079749:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2354:x1875453495328128:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572277.079769:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2354:x1875453495328128:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 20us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572277.079775:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00080000:0.0:1788572277.079793:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572277.079796:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572277.080080:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495328000 00000100:00100000:3.0:1788572277.080085:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495328000 00000100:00100000:3.0:1788572277.080124:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495327616 00000100:00100000:3.0:1788572277.080127:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495327616 00000100:00100000:3.0:1788572277.080152:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:3.0:1788572277.080159:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:2354:x1875453495328000:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572277.080195:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:2354:x1875453495328000:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572277.080202:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:3.0:1788572277.080213:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788572277.080226:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:2354:x1875453495327616:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572277.080279:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:2354:x1875453495327616:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572277.080286:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1788572277.080441:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495327488 00000100:00100000:2.0:1788572277.080451:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495327488 00000100:00100000:2.0:1788572277.080489:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:2.0:1788572277.080496:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:2354:x1875453495327488:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572277.080541:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:2354:x1875453495327488:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 46us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572277.080548:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00080000:0.0:1788572277.080760:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572277.361453:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518390400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572277.361548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572277.362046:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518390400 00000100:00100000:3.0:1788572277.362055:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518390400 00000100:00100000:3.0:1788572277.362117:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788572277.362129:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518390400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572277.362161:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788572277.362215:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875453518390400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572277.362223:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788572277.362390:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572277.362407:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518390528:0@lo:400:kworker.0 00000100:00100000:3.0:1788572277.362447:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572277.362448:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518390784:0@lo:400:kworker.0 00000100:00100000:3.0:1788572277.362474:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518391040:0@lo:400:kworker.0 00000100:00100000:1.0:1788572277.362493:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572277.362507:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518390656:0@lo:400:kworker.0 00000100:00100000:3.0:1788572277.362533:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572277.362563:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518390656 00000100:00100000:3.0:1788572277.362566:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518390656 00000100:00100000:3.0:1788572277.362590:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788572277.362596:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518390656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572277.362626:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875453518390656:12345-0@lo:400:kworker.0 Request processed in 30us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572277.362631:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788572277.362677:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518390656:0@lo:400:kworker.0 00000100:00100000:0.0:1788572277.362758:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518390784 00000100:00100000:0.0:1788572277.362762:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518390784 00000100:00100000:0.0:1788572277.362790:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572277.362797:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518390784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572277.362834:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875453518390784:12345-0@lo:400:kworker.0 Request processed in 38us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572277.362839:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788572277.362871:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572277.363558:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518390528 00000100:00100000:2.0:1788572277.363564:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518390528 00000100:00100000:2.0:1788572277.363597:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788572277.363604:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3297:x1875453518390528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572277.363645:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3297:x1875453518390528:12345-0@lo:400:kworker.0 Request processed in 43us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572277.363651:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788572277.363714:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518390528:0@lo:400:kworker.0 00000100:00100000:2.0:1788572277.363738:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518390912:0@lo:400:kworker.0 00000100:00100000:2.0:1788572277.363764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572277.363807:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1875453518390400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572277.363830:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518391040 00000100:00100000:2.0:1788572277.363832:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518391040 00000100:00100000:2.0:1788572277.363853:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518390912 00000100:00100000:2.0:1788572277.363855:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518390912 00000100:00100000:2.0:1788572277.363865:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788572277.363869:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518391040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572277.363907:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875453518391040:12345-0@lo:400:kworker.0 Request processed in 37us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572277.363914:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788572277.363926:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788572277.363932:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518390912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572277.363967:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875453518390912:12345-0@lo:400:kworker.0 Request processed in 36us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572277.363973:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788572277.363987:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572277.364014:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1875453518391040:0@lo:400:kworker.0 00000100:00100000:2.0:1788572277.364039:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1875453518390912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572277.364172:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07667a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875453518390784:0@lo:400:kworker.0 00010000:00010000:0.0:1788572277.418595:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572278.223742:0:16475:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0611f900 20000000:00000080:0.0:1788572278.223761:0:16475:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88bf45556c00 uarg=0000000000000000 20000000:01000000:0.0:1788572278.223799:0:16475:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788572278.223805:0:16475:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788572278.223809:0:16475:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788572278.231082:0:16476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788572278.237617:0:16475:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788572278.245313:0:16475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788572278.245897:0:16475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.245918:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c006c4 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.245926:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00711 expref: 18 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.245933:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00845 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.245943:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11242 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.245951:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112a4 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.245958:0:16475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.246001:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112a4 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.246016:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112a4 expref: 12 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572278.246028:0:16475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391168:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572278.246133:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11242 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.246159:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11242 expref: 12 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572278.246167:0:16475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391296:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572278.246195:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c00845 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.246203:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c00845 expref: 18 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572278.246212:0:16475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd12300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391424:0@lo:104: 00000100:00100000:1.0:1788572278.246302:0:16475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572278.246337:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c00711 expref: 18 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.246345:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c00711 expref: 18 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572278.246354:0:16475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd13100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391552:0@lo:104: 00000100:00100000:1.0:1788572278.246377:0:16475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572278.246399:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x977d9e7969c006c4 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.246407:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x977d9e7969c006c4 expref: 18 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572278.246414:0:16475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391680:0@lo:104: 00000100:00100000:1.0:1788572278.246438:0:16475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572278.246687:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518391424 00000100:00100000:2.0:1788572278.246695:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518391424 00000100:00100000:2.0:1788572278.246737:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518391552 00000100:00100000:2.0:1788572278.246740:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518391552 00000100:00100000:2.0:1788572278.246755:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788572278.246763:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf634c0e-dd8a-4982-ad2a-0f984621b961+4:16475:x1875453518391424:12345-0@lo:104: 00010000:00010000:2.0:1788572278.246775:0:14345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.246820:0:14345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788572278.246826:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf634c0e-dd8a-4982-ad2a-0f984621b961+4:16475:x1875453518391424:12345-0@lo:104: Request processed in 65us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572278.246833:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788572278.246851:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788572278.246857:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:16475:x1875453518391552:12345-0@lo:104: 00010000:00010000:2.0:1788572278.246871:0:14345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.246905:0:14345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788572278.246910:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:16475:x1875453518391552:12345-0@lo:104: Request processed in 54us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572278.246917:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788572278.246934:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572278.246940:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.246947:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994000 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572278.246951:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.246959:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572278.246968:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572278.246974:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572278.247023:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.247030:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572278.247047:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.247053:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c076994000/0x977d9e7969c00845 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c0084c expref: -99 pid: 15764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.247073:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572278.247076:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.247081:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c000 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:2.0:1788572278.247084:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.247090:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572278.247095:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572278.247100:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572278.247112:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.247118:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572278.247133:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.247140:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c058a0c000/0x977d9e7969c00711 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c00718 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572278.247149:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572278.247151:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572278.247152:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572278.247160:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572278.247179:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518391808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572278.247206:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572278.247237:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf634c0e-dd8a-4982-ad2a-0f984621b961:3299:1875453518391936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572278.247295:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572278.247602:0:16475:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c052a4af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572278.247625:0:16475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd12300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391424:0@lo:104: 00000100:00100000:1.0:1788572278.247633:0:16475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd13100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391552:0@lo:104: 00000100:00100000:3.0:1788572278.247786:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788572278.247798:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518391680 00000100:00100000:3.0:1788572278.247802:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518391680 00000100:00100000:3.0:1788572278.247824:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572278.247830:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076c7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:16475:x1875453518391680:12345-0@lo:104: 00010000:00010000:3.0:1788572278.247838:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.247888:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788572278.247893:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076c7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf634c0e-dd8a-4982-ad2a-0f984621b961+3:16475:x1875453518391680:12345-0@lo:104: Request processed in 63us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572278.247898:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788572278.247940:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572278.247944:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.247950:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c041387c00 already unused, calling callback (ffffffffc1aa4c20) 10000000:00010000:3.0:1788572278.247953:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.247960:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572278.247966:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572278.247972:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788572278.247995:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248001:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572278.248011:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248018:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff88c041387c00/0x977d9e7969c006c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x977d9e7969c006cb expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248031:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572278.248033:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572278.248035:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572278.248043:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf634c0e-dd8a-4982-ad2a-0f984621b961:3300:1875453518392064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572278.248068:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572278.248104:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518391808 00000100:00100000:3.0:1788572278.248108:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518391808 00010000:00010000:3.0:1788572278.248127:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00845 expref: 19 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572278.248140:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518391936 00000100:00100000:3.0:1788572278.248143:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518391936 00010000:00010000:3.0:1788572278.248152:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00711 expref: 20 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572278.248161:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518392064 00000100:00100000:3.0:1788572278.248163:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518392064 00010000:00010000:3.0:1788572278.248174:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c006c4 expref: 21 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572278.248185:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572278.248190:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf634c0e-dd8a-4982-ad2a-0f984621b961+21:3297:x1875453518391808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572278.248206:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572278.248211:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00845 expref: 21 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248220:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c00845 expref: 21 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248233:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c05024b400/0x977d9e7969c0084c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c00845 expref: 21 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572278.248458:0:16475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391680:0@lo:104: 00010000:00010000:3.0:1788572278.248640:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572278.248673:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf634c0e-dd8a-4982-ad2a-0f984621b961+20:3297:x1875453518391808:12345-0@lo:103:ldlm_bl.0 Request processed in 483us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572278.248680:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788572278.248695:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572278.248701:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3299:x1875453518391936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572278.248710:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572278.248715:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c00711 expref: 19 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248723:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c00711 expref: 19 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248732:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c041387800/0x977d9e7969c00718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c00711 expref: 19 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248740:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572278.248760:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:3299:x1875453518391936:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572278.248776:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788572278.248788:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788572278.248794:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058efe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:3300:x1875453518392064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572278.248801:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572278.248806:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x977d9e7969c006c4 expref: 17 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248815:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x977d9e7969c006c4 expref: 17 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248824:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c05024aa00/0x977d9e7969c006cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x977d9e7969c006c4 expref: 17 pid: 14353 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.248831:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572278.248857:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058efe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:3300:x1875453518392064:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572278.248863:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788572278.249011:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf634c0e-dd8a-4982-ad2a-0f984621b961:3297:1875453518391808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572278.249962:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf634c0e-dd8a-4982-ad2a-0f984621b961:3300:1875453518392064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572278.249989:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0502ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf634c0e-dd8a-4982-ad2a-0f984621b961:3299:1875453518391936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572278.251076:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572278.259648:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572278.259726:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572278.259795:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495328384 00000100:00100000:0.0:1788572278.259805:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495328384 00010000:00010000:0.0:1788572278.259848:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112a4 expref: 13 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572278.259896:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495328512 00000100:00100000:0.0:1788572278.259899:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495328512 00010000:00010000:0.0:1788572278.259912:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11242 expref: 14 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572278.259926:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788572278.259934:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+14:2353:x1875453495328384:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572278.259948:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572278.259953:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112a4 expref: 14 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.259965:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112a4 expref: 14 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.259985:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572278.260036:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+14:2353:x1875453495328384:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 102us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572278.260043:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788572278.260063:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1788572278.260069:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:2353:x1875453495328512:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572278.260076:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572278.260095:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11242 expref: 13 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260105:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11242 expref: 13 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260116:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260125:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260140:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260147:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260165:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260173:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260179:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572278.260183:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260194:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260202:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572278.260219:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572278.260241:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:2353:x1875453495328512:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 171us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572278.260284:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00010000:00010000:1.0:1788572278.260983:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c05024ba00/0x977d9e7969c009aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112a4 expref: 12 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572278.260998:0:16475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf47695f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391168:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572278.261009:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c052e4d600/0x977d9e7969c00972 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11242 expref: 11 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572278.261017:0:16475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875453518391296:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788572278.261046:0:16475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.261055:0:16475:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.261060:0:16475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572278.261066:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88c076994600/0x977d9e7969c009d4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572278.443909:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572279.448939:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572279.461060:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495328640 00000100:00100000:3.0:1788572279.461076:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495328640 00000100:00100000:3.0:1788572279.461127:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:3.0:1788572279.461150:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+11:13795:x1875453495328640:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572279.461166:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572279.461185:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c052e4d800/0x977d9e7969c009db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb112d5 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.461223:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c052e4d800/0x977d9e7969c009db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112d5 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.461235:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c052e4d800/0x977d9e7969c009db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112d5 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.461270:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4d800, rc 0) 00000100:00100000:3.0:1788572279.461385:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13795:x1875453495328640:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 236us (12455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572279.461392:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 105 00010000:00010000:1.0:1788572279.472384:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572279.479583:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572279.481410:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495328768 00000100:00100000:0.0:1788572279.481423:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495328768 00000100:00100000:0.0:1788572279.482823:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:0.0:1788572279.482839:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13795:x1875453495328768:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.483127:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13795:x1875453495328768:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 292us (3550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572279.483137:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:0.0:1788572279.509577:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572279.509747:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495328896 00000100:00100000:0.0:1788572279.509765:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495328896 00000100:00100000:0.0:1788572279.509879:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:0.0:1788572279.509897:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13795:x1875453495328896:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.510195:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13795:x1875453495328896:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 306us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572279.510204:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 107 10000000:01000000:3.0:1788572279.529307:0:14358:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788572279.529315:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf4531a000 from 10 10000000:01000000:3.0:1788572279.529321:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572279.529365:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4ca00/0x977d9e7969c009e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.529377:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c052e4ca00/0x977d9e7969c009e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.529388:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c052e4ca00/0x977d9e7969c009e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572279.529414:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572279.529499:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572279.529555:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572279.529578:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518392192 00000100:00100000:3.0:1788572279.529586:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518392192 00000100:00100000:3.0:1788572279.529659:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788572279.529675:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+16:14358:x1875453518392192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572279.529690:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572279.529703:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c052e4c400/0x977d9e7969c009e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c009e2 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.529733:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c052e4c400/0x977d9e7969c009e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c009e2 expref: 17 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.529745:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c052e4c400/0x977d9e7969c009e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c009e2 expref: 17 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.529760:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4c400, rc 0) 00000100:00100000:3.0:1788572279.529801:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:14358:x1875453518392192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572279.529807:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788572279.529855:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572279.529869:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c052e4ca00/0x977d9e7969c009e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c009e9 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.529877:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c052e4ca00/0x977d9e7969c009e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c009e9 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572279.529928:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572279.529977:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572279.529994:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572279.530006:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518392320 00000100:00100000:3.0:1788572279.530009:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518392320 00000100:00100000:3.0:1788572279.530052:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788572279.530065:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:14358:x1875453518392320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572279.530362:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:14358:x1875453518392320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572279.530388:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788572279.530418:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572279.530446:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572279.530480:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572279.530492:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572279.530501:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518392448 00000100:00100000:3.0:1788572279.530504:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518392448 00000100:00100000:3.0:1788572279.530521:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788572279.530527:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:14358:x1875453518392448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572279.530669:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:14358:x1875453518392448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572279.530676:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788572279.530712:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.537169:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000040:00080000:0.0:1788572279.537859:0:16538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:3.0:1788572279.538648:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495329024 00000100:00100000:3.0:1788572279.538657:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495329024 00000100:00100000:3.0:1788572279.538710:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 111 00000100:00100000:3.0:1788572279.538719:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+12:13795:x1875453495329024:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572279.538734:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572279.538752:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c052e4c600/0x977d9e7969c009f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d478a807bb112dc expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.538779:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c052e4c600/0x977d9e7969c009f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112dc expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.538813:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c052e4c600/0x977d9e7969c009f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112dc expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.538824:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4c600, rc 0) 00000100:00100000:3.0:1788572279.538882:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13795:x1875453495329024:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 163us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572279.538889:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 111 00000020:01000000:3.0:1788572279.541905:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788572279.541939:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572279.541950:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4ca00/0x977d9e7969c009e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c009e9 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.541962:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c052e4ca00/0x977d9e7969c009e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c009e9 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572279.541974:0:14358:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788572279.541977:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88c048290800 from 10 10000000:01000000:3.0:1788572279.541979:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572279.542025:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c009f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.542034:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c009f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572279.542718:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c009f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572279.542753:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572279.542849:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572279.551223:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c047048b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572279.551347:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572279.568452:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518392576 00000100:00100000:0.0:1788572279.568480:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518392576 00000100:00100000:0.0:1788572279.568706:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495329152 00000100:00100000:0.0:1788572279.568723:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495329152 00000100:00100000:0.0:1788572279.568759:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788572279.568771:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+17:14358:x1875453518392576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572279.568990:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572279.569010:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c05024ac00/0x977d9e7969c009fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c009f7 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572279.569071:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c05024ac00/0x977d9e7969c009fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c009f7 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572279.569084:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c05024ac00/0x977d9e7969c009fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c009f7 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572279.569094:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ac00, rc 0) 00000100:00100000:0.0:1788572279.569783:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:14358:x1875453518392576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1010us (26930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572279.570024:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788572279.570086:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:0.0:1788572279.570097:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13795:x1875453495329152:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.572272:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13795:x1875453495329152:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 2139us (20891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572279.572356:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:0.0:1788572279.572449:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076678a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572279.573051:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c009f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c009fe expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572279.573066:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c009f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c009fe expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572279.573867:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.573926:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572279.573973:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572279.577431:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518392704 00000100:00100000:1.0:1788572279.577465:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518392704 00000100:00100000:1.0:1788572279.577858:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788572279.577872:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:14358:x1875453518392704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572279.582750:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:14358:x1875453518392704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4866us (8808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572279.582765:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788572279.584112:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.584178:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.584770:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572279.584809:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c051598000 going to sleep for 11 seconds 00000100:00100000:1.0:1788572279.585213:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518392832 00000100:00100000:1.0:1788572279.585221:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518392832 00000100:00100000:1.0:1788572279.585370:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788572279.585381:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:14358:x1875453518392832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.586717:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572279.586754:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495329280 00000100:00100000:0.0:1788572279.586761:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495329280 00000100:00100000:0.0:1788572279.586796:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:0.0:1788572279.586804:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13795:x1875453495329280:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.586953:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:13795:x1875453495329280:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 149us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572279.586961:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:1.0:1788572279.587408:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:14358:x1875453518392832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2027us (2637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572279.587416:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788572279.587661:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788572279.596322:0:16541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788572279.602420:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788572279.602453:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788572279.602464:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c009f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c009fe expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572279.602487:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c052e4c200/0x977d9e7969c009f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c009fe expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572279.602620:0:14358:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788572279.602623:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88bf452dd800 from 10 10000000:01000000:0.0:1788572279.602626:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788572279.602665:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024b800/0x977d9e7969c00a05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572279.602673:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff88c05024b800/0x977d9e7969c00a05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572279.602683:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff88c05024b800/0x977d9e7969c00a05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572279.602707:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572279.602771:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572279.602821:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c058f7c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572279.603272:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518392960 00000100:00100000:1.0:1788572279.603281:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518392960 00000100:00100000:1.0:1788572279.603342:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788572279.603351:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+18:14358:x1875453518392960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572279.603364:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572279.603378:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88c076995000/0x977d9e7969c00a0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x977d9e7969c00a05 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572279.603401:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88c076995000/0x977d9e7969c00a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x977d9e7969c00a05 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572279.603411:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88c076995000/0x977d9e7969c00a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x977d9e7969c00a05 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572279.603432:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995000, rc 0) 00000100:00100000:1.0:1788572279.603487:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:14358:x1875453518392960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572279.603494:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788572279.603549:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518392960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572279.603564:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff88c05024b800/0x977d9e7969c00a05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00a0c expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572279.603574:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff88c05024b800/0x977d9e7969c00a05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x977d9e7969c00a0c expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572279.603621:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518393088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572279.603646:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572279.603665:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572279.603676:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518393088 00000100:00100000:1.0:1788572279.603679:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518393088 00000100:00100000:1.0:1788572279.603696:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788572279.603701:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:14358:x1875453518393088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572279.603910:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:14358:x1875453518393088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572279.603916:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788572279.603943:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518393088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572279.603966:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518393216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572279.604656:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572279.604691:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07bab80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572279.604708:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518393216 00000100:00100000:1.0:1788572279.604712:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518393216 00000100:00100000:1.0:1788572279.604736:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788572279.604742:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf455b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:14358:x1875453518393216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572279.604886:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf455b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:14358:x1875453518393216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572279.604893:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788572279.604931:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf634c0e-dd8a-4982-ad2a-0f984621b961:14358:1875453518393216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572279.639923:0:16543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788572279.644016:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788572279.644057:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788572279.644070:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff88c05024b800/0x977d9e7969c00a05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00a0c expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572279.644083:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff88c05024b800/0x977d9e7969c00a05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x977d9e7969c00a0c expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572279.977988:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788572280.492596:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572281.512637:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572281.524420:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.524515:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495329408 00000100:00100000:2.0:1788572281.524525:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495329408 00000100:00100000:2.0:1788572281.524600:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1788572281.524612:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:14455:x1875453495329408:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572281.524632:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572281.524654:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb112e3 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.524723:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.524738:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.524751:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.524766:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.524773:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.524798:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525100:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00a28 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525109:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00a28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525116:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00a28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572281.525140:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788572281.525144:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572281.525194:0:14363:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00a28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525205:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525212:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525219:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525236:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572281.525240:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525275:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525294:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907700) 00010000:00010000:2.0:1788572281.525298:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572281.525303:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525309:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00a1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525323:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525329:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525335:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525341:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0cc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572281.525343:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525348:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525355:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88c0593ef700) 00010000:00010000:2.0:1788572281.525357:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572281.525360:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525366:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00a21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525412:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112e3 expref: 8 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525425:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c000/0x977d9e7969c00a28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112e3 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.525432:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:2.0:1788572281.525434:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572281.525436:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c000, rc 0) 00000100:00100000:2.0:1788572281.525509:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:14455:x1875453495329408:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 899us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572281.525517:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00080000:3.0:1788572281.525801:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572281.527794:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572281.527908:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495329664 00000100:00100000:0.0:1788572281.527917:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495329664 00000100:00100000:0.0:1788572281.527970:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1788572281.527979:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:14455:x1875453495329664:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572281.527996:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572281.528019:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00a2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb112ea expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528081:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528096:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528118:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528203:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528214:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528221:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528554:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00a44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528564:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00a44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528571:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00a44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572281.528581:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788572281.528732:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528737:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528742:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528745:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572281.528752:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528757:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528765:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88c0593ef100) 00010000:00010000:0.0:1788572281.528767:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572281.528770:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528774:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528782:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528786:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528789:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528791:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572281.528793:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528796:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528799:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88c0481bf400) 00010000:00010000:0.0:1788572281.528801:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572281.528806:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.528809:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.529160:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00a2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ea expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.529173:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024aa00/0x977d9e7969c00a44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ea expref: 9 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.529180:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:0.0:1788572281.529182:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572281.529184:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024aa00, rc 0) 00000100:00100000:0.0:1788572281.529763:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:14455:x1875453495329664:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1782us (1973us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788572281.529771:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1788572281.533317:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.533385:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495329792 00000100:00100000:2.0:1788572281.533394:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495329792 00000100:00100000:2.0:1788572281.533439:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1788572281.533446:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:14455:x1875453495329792:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788572281.533553:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:14455:x1875453495329792:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 106us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572281.533560:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1788572281.559514:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572281.559641:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495329920 00000100:00100000:3.0:1788572281.559650:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495329920 00000100:00100000:3.0:1788572281.559696:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788572281.559704:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:14461:x1875453495329920:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788572281.559720:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572281.559736:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00a52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb112f1 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.559788:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.559798:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.559807:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.559820:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.559827:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.559833:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560008:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560014:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560019:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560022:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572281.560025:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560031:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560039:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907700) 00010000:00010000:3.0:1788572281.560041:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572281.560044:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560048:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560057:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560060:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560064:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560071:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4da00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572281.560073:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560076:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560080:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88c058907900) 00010000:00010000:3.0:1788572281.560081:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572281.560083:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560086:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560108:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00a52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112f1 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560114:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907700) 00010000:00010000:3.0:1788572281.560116:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572281.560118:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00a52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112f1 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.560123:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4c800, rc 0) 00000100:00100000:3.0:1788572281.560199:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:14461:x1875453495329920:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 495us (696us total) trans 0 rc 301/301 00000100:00100000:3.0:1788572281.560204:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788572281.562997:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.563098:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495330048 00000100:00100000:2.0:1788572281.563107:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495330048 00000100:00100000:2.0:1788572281.563203:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1788572281.563212:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:14461:x1875453495330048:12345-192.168.202.2@tcp:700:lfs.0 00000100:00100000:2.0:1788572281.563345:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:14461:x1875453495330048:12345-192.168.202.2@tcp:700:lfs.0 Request processed in 133us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572281.563359:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788572281.564865:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.564936:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495330304 00000100:00100000:2.0:1788572281.564944:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495330304 00000100:00100000:2.0:1788572281.565039:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788572281.565046:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:14461:x1875453495330304:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:2.0:1788572281.565091:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572281.565110:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4cc00/0x977d9e7969c00995 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1126c expref: 9 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.565125:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907700) 00010000:00010000:2.0:1788572281.565129:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572281.565651:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.565662:0:14363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ce expref: 5 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.565669:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.565694:0:14363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ce expref: 5 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.565703:0:14363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ce expref: 5 pid: 15283 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572281.565714:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14363:1875453518393344:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572281.565823:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572281.567274:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14363:1875453518393344:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572281.567295:0:14363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572281.567859:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572281.568107:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495330432 00000100:00100000:0.0:1788572281.568119:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495330432 00010000:00010000:0.0:1788572281.568163:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ce expref: 6 pid: 15283 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572281.568194:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788572281.568202:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:2356:x1875453495330432:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572281.568214:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572281.568220:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ce expref: 6 pid: 15283 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788572281.568330:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788572281.568428:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ce expref: 6 pid: 15283 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.568446:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4dc00/0x977d9e7969c009cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ce expref: 6 pid: 15283 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.568465:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907700) 00010000:00010000:0.0:1788572281.568469:0:14346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.568476:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.568482:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.568505:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572281.568616:0:14363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.568622:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.568639:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.568650:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.568655:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572281.569346:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2356:x1875453495330432:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 1138us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572281.569355:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000004:00200000:1.0:1788572281.570074:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788572281.570085:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.570092:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.570096:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.570099:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572281.570103:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.570107:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.570117:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907700) 00010000:00010000:1.0:1788572281.570118:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572281.570121:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.570125:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00a67 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572281.570153:0:14363:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013ca56d5 reply state 000000008d62de43 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572281.570161:0:14363:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572281.570236:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+10:14461:x1875453495330304:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 5177us (5366us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788572281.570241:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00010000:00010000:2.0:1788572281.571651:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.571666:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.571674:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.571678:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572281.571681:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.571685:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.571696:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88c058eacb00) 00010000:00010000:2.0:1788572281.571698:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572281.571701:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.571705:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00a6e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572281.620096:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572281.620229:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495330560 00000100:00100000:3.0:1788572281.620241:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495330560 00000100:00100000:3.0:1788572281.620399:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1788572281.620410:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:14469:x1875453495330560:12345-192.168.202.2@tcp:101:lctl.0 00010000:00010000:3.0:1788572281.620435:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572281.620557:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00a75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb112f8 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.620622:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.620633:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.620643:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572281.620675:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572281.620678:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572281.620705:0:14362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.620722:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00a75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112f8 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.620737:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4da00/0x977d9e7969c00a7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112f8 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.620742:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:3.0:1788572281.620758:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572281.620762:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4da00, rc 0) 00000100:00100000:3.0:1788572281.620885:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+10:14469:x1875453495330560:12345-192.168.202.2@tcp:101:lctl.0 Request processed in 476us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572281.620891:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1788572281.646755:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572281.646845:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495330688 00000100:00100000:0.0:1788572281.646854:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495330688 00000100:00100000:0.0:1788572281.646916:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788572281.646927:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:14470:x1875453495330688:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572281.646946:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572281.646967:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb112ff expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.647048:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.647062:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.647073:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572281.647104:0:15283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788572281.647107:0:15283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572281.647127:0:15283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.647160:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ff expref: 7 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.647179:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a400/0x977d9e7969c00a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb112ff expref: 6 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.647186:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:0.0:1788572281.647189:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572281.647193:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a400, rc 0) 00000100:00100000:0.0:1788572281.647328:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:14470:x1875453495330688:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 402us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572281.647335:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788572281.651921:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572281.651992:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495330816 00000100:00100000:3.0:1788572281.652002:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495330816 00000100:00100000:3.0:1788572281.652061:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1788572281.652072:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:14470:x1875453495330816:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788572281.652089:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572281.652109:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11306 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652608:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652623:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652635:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652649:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652657:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652663:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652764:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4de00/0x977d9e7969c00aa6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652773:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4de00/0x977d9e7969c00aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652779:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4de00/0x977d9e7969c00aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572281.652806:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788572281.652810:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572281.652832:0:14361:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4de00/0x977d9e7969c00aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652844:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652850:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652856:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652862:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572281.652866:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652873:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652886:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:3.0:1788572281.652896:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572281.652901:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652907:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00a98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652919:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652925:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652931:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652937:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572281.652939:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652945:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652952:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88c058907d00) 00010000:00010000:3.0:1788572281.652955:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572281.652958:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652964:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00a9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.652995:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11306 expref: 8 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.653020:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4de00/0x977d9e7969c00aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11306 expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.653027:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058907400) 00010000:00010000:3.0:1788572281.653030:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572281.653032:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4de00, rc 0) 00000100:00100000:3.0:1788572281.653149:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+7:14470:x1875453495330816:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1079us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572281.653157:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788572281.657654:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.657757:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495331072 00000100:00100000:2.0:1788572281.657766:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495331072 00000100:00100000:2.0:1788572281.657927:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1788572281.657938:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+7:14470:x1875453495331072:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572281.657960:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572281.657982:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00aad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1130d expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572281.658066:0:15283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788572281.658183:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00aad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1130d expref: 9 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.658198:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:2.0:1788572281.658201:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572281.658205:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00aad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1130d expref: 9 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.658219:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d400, rc 0) 00000100:00100000:2.0:1788572281.658325:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+8:14470:x1875453495331072:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 389us (680us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788572281.658332:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788572281.661180:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572281.662046:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495331328 00000100:00100000:1.0:1788572281.662058:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495331328 00000100:00100000:2.0:1788572281.662139:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1788572281.662154:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+8:14470:x1875453495331328:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:2.0:1788572281.662204:0:15283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572281.662236:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4de00/0x977d9e7969c00aa6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11306 expref: 8 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.662290:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058907400) 00010000:00010000:2.0:1788572281.662301:0:15283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572281.662335:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.662348:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.662358:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572281.662835:0:15283:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058667066 reply state 000000007f24c30d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572281.662846:0:15283:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788572281.662853:0:15283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788572281.662935:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+9:14470:x1875453495331328:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 785us (1763us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788572281.662943:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00010000:00010000:2.0:1788572281.665046:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.665064:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.665072:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.665077:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572281.665082:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.665089:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.665120:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c0593ef700) 00010000:00010000:2.0:1788572281.665123:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788572281.665128:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.665134:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00abb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572281.666705:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.666844:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495331584 00000100:00100000:2.0:1788572281.666856:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495331584 00000100:00100000:2.0:1788572281.666904:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:2.0:1788572281.666914:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+8:14470:x1875453495331584:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572281.667139:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+9:14470:x1875453495331584:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 226us (443us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788572281.667147:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1788572281.670703:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572281.670998:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495331840 00000100:00100000:1.0:1788572281.671006:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495331840 00000100:00100000:1.0:1788572281.671052:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:1.0:1788572281.671061:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+9:14470:x1875453495331840:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572281.671078:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572281.671095:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00ac2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11314 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671159:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671174:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671185:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671198:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671217:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671232:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572281.671350:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788572281.671419:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671427:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671433:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671438:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994e00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572281.671442:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671601:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671614:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:1.0:1788572281.671617:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572281.671622:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671628:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00ac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671651:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671657:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671662:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671668:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572281.671671:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671677:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671685:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88c058eaca00) 00010000:00010000:1.0:1788572281.671687:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572281.671690:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671696:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00ad0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671734:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00ac2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11314 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671743:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:1.0:1788572281.671745:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572281.671752:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00ac2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11314 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.671759:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995a00, rc 0) 00000100:00100000:1.0:1788572281.671972:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+10:14470:x1875453495331840:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 910us (1277us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788572281.671980:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788572281.675149:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572281.675214:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495331968 00000100:00100000:1.0:1788572281.675230:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495331968 00000100:00100000:1.0:1788572281.675431:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:1.0:1788572281.675442:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+10:14470:x1875453495331968:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788572281.675597:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572281.675620:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00ade lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1131b expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.675703:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.675716:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.675728:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572281.675753:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788572281.675756:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572281.675773:0:14363:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.675796:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00ade lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1131b expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.676161:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1131b expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.676170:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058eac900) 00010000:00010000:1.0:1788572281.676173:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572281.676177:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995800, rc 0) 00000100:00100000:0.0:1788572281.676617:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+11:14470:x1875453495331968:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1175us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572281.676626:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:0.0:1788572281.683655:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.683815:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495332096 00000100:00100000:2.0:1788572281.683832:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495332096 00000100:00100000:2.0:1788572281.683889:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:2.0:1788572281.683901:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+11:14470:x1875453495332096:12345-192.168.202.2@tcp:37:lfs.0 00000100:00100000:2.0:1788572281.694713:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+11:14470:x1875453495332096:12345-192.168.202.2@tcp:37:lfs.0 Request processed in 10804us (11056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572281.694725:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1788572281.703062:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572281.703147:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495332352 00000100:00100000:0.0:1788572281.703157:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495332352 00000100:00100000:0.0:1788572281.703234:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788572281.703274:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0591b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+11:14470:x1875453495332352:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788572281.703510:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0591b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+12:14470:x1875453495332352:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 266us (457us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788572281.703519:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788572281.770207:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.770387:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495332480 00000100:00100000:2.0:1788572281.770397:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495332480 00000100:00100000:2.0:1788572281.770605:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788572281.770619:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+10:14477:x1875453495332480:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572281.770656:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572281.770725:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00aec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11322 expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.770781:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.770792:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.770852:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.770872:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.770880:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.770888:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.770967:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00b01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.770975:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00b01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.770981:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00b01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572281.771007:0:15283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788572281.771013:0:15283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572281.771043:0:15283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00b01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771052:0:15283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771057:0:15283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771061:0:15283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771065:0:15283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572281.771068:0:15283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771073:0:15283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771081:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:2.0:1788572281.771083:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572281.771085:0:15283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771089:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771097:0:15283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771101:0:15283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771111:0:15283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771114:0:15283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0c200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572281.771116:0:15283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771119:0:15283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771123:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88c0593ef700) 00010000:00010000:2.0:1788572281.771125:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572281.771126:0:15283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771129:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c200/0x977d9e7969c00afa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771159:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d400/0x977d9e7969c00aec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11322 expref: 12 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771173:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0cc00/0x977d9e7969c00b01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11322 expref: 11 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.771179:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058eac900) 00010000:00010000:2.0:1788572281.771181:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788572281.771183:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0cc00, rc 0) 00000100:00100000:2.0:1788572281.771415:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+11:14477:x1875453495332480:12345-192.168.202.2@tcp:101:bash.0 Request processed in 797us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572281.771431:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788572281.773643:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572281.773734:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495332736 00000100:00100000:3.0:1788572281.773743:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495332736 00000100:00100000:3.0:1788572281.773794:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:3.0:1788572281.773815:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+11:14477:x1875453495332736:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788572281.773835:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572281.773855:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00b08 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11329 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.773953:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.773966:0:14361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1131b expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.773975:0:14361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.774018:0:14361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1131b expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.774028:0:14361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1131b expref: 11 pid: 14363 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572281.774038:0:14361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14361:1875453518393472:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788572281.774108:0:14361:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0470486c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572281.776626:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.776916:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495332864 00000100:00100000:2.0:1788572281.776924:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495332864 00010000:00010000:2.0:1788572281.776965:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1131b expref: 12 pid: 14363 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572281.777007:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1788572281.777015:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+12:2356:x1875453495332864:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572281.777027:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572281.777032:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1131b expref: 12 pid: 14363 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.777041:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1131b expref: 12 pid: 14363 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.777058:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058eac900) 00010000:00010000:2.0:1788572281.777062:0:14348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.777069:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.777074:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.777087:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572281.777128:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+12:2356:x1875453495332864:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 115us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572281.777364:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00010000:00010000:3.0:1788572281.778066:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995800/0x977d9e7969c00ae5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1131b expref: 11 pid: 14363 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572281.778079:0:14361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c076679f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14361:1875453518393472:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788572281.778097:0:14361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.778103:0:14361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.778107:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.778124:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.778230:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.778240:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780080:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780099:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780110:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572281.780122:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788572281.780212:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780218:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780234:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780240:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572281.780244:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780364:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780376:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058eac900) 00010000:00010000:3.0:1788572281.780379:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572281.780385:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780402:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b0f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572281.780411:0:14361:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059ff5de8 reply state 00000000c3a9ed15 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572281.780418:0:14361:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788572281.780450:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00b08 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11329 expref: 14 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780467:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11329 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.780474:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:3.0:1788572281.780476:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788572281.780478:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4d200, rc 0) 00000100:00100000:3.0:1788572281.780616:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+14:14477:x1875453495332736:12345-192.168.202.2@tcp:101:bash.0 Request processed in 6811us (6977us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788572281.780624:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00010000:00010000:2.0:1788572281.782408:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.782421:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.782426:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.782431:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572281.782434:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.782440:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.782451:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88c058907d00) 00010000:00010000:2.0:1788572281.782453:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572281.782456:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.782462:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00b16 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572281.790480:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572281.791123:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495332992 00000100:00100000:0.0:1788572281.791145:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495332992 00000100:00100000:0.0:1788572281.791289:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:0.0:1788572281.791300:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+13:14477:x1875453495332992:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572281.791327:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572281.791350:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00b2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11330 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.791414:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00b32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.791431:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00b32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.791475:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00b32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572281.791517:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788572281.791530:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572281.791553:0:14362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00b32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.791563:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00b32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.791586:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00b2b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11330 expref: 15 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.791604:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00b32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11330 expref: 14 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.791613:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:0.0:1788572281.791616:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572281.791620:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a000, rc 0) 00000100:00100000:0.0:1788572281.791696:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+14:14477:x1875453495332992:12345-192.168.202.2@tcp:101:bash.0 Request processed in 397us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572281.791703:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:1.0:1788572281.794696:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572281.794768:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495333248 00000100:00100000:3.0:1788572281.794775:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495333248 00000100:00100000:3.0:1788572281.794830:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788572281.794840:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+14:14477:x1875453495333248:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:3.0:1788572281.795150:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+15:14477:x1875453495333248:12345-192.168.202.2@tcp:35:bash.0 Request processed in 312us (464us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788572281.795156:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:1.0:1788572281.878443:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572281.878516:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495333504 00000100:00100000:0.0:1788572281.878525:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495333504 00000100:00100000:0.0:1788572281.878584:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:0.0:1788572281.878593:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+15:14487:x1875453495333504:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572281.878612:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572281.878639:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11337 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572281.878718:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788572281.878809:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00b39 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11337 expref: 17 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.878819:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:0.0:1788572281.878821:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572281.878848:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11337 expref: 17 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572281.878863:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b600, rc 0) 00000100:00100000:0.0:1788572281.878915:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+16:14487:x1875453495333504:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 322us (478us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788572281.878920:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:3.0:1788572281.882560:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.882789:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495333760 00000100:00100000:2.0:1788572281.882798:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495333760 00000100:00100000:2.0:1788572281.883486:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:2.0:1788572281.883495:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+16:14487:x1875453495333760:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788572281.883703:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+17:14487:x1875453495333760:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 208us (1153us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788572281.883718:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788572281.910486:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572281.913490:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495334016 00000100:00100000:2.0:1788572281.913505:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495334016 00000100:00100000:3.0:1788572281.914487:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1788572281.914499:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+17:14490:x1875453495334016:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788572281.914526:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572281.914550:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00b47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1133e expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.914657:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.914675:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.914690:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572281.914704:0:15283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788572281.915004:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00b47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1133e expref: 20 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.915026:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1133e expref: 19 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572281.915036:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:3.0:1788572281.915039:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572281.915042:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4d000, rc 0) 00000100:00100000:3.0:1788572281.915118:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+19:14490:x1875453495334016:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 621us (4641us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788572281.915125:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:0.0:1788572281.919588:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572281.919695:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572281.919853:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495334144 00000100:00100000:1.0:1788572281.919863:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495334144 00000100:00100000:1.0:1788572281.919924:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:1.0:1788572281.919934:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+19:14490:x1875453495334144:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:1.0:1788572281.920014:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.920031:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.920043:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.920070:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.920094:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.920103:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.920109:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572281.920113:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.920121:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.920145:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:1.0:1788572281.920148:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788572281.920154:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572281.920161:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b5c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572281.920339:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+19:14490:x1875453495334144:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 405us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572281.920347:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:2.0:1788572281.921087:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495334272 00000100:00100000:2.0:1788572281.921096:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495334272 00000100:00100000:2.0:1788572281.921165:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1788572281.921175:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+19:2356:x1875453495334272:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788572281.921189:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572281.921208:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00b4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1133e expref: 19 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572281.921232:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:2.0:1788572281.921236:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572281.921301:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+18:2356:x1875453495334272:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 128us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572281.921309:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788572281.926996:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572281.927084:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495334528 00000100:00100000:0.0:1788572281.927093:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495334528 00000100:00100000:0.0:1788572281.927181:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788572281.927192:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+18:14490:x1875453495334528:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788572281.927460:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+19:14490:x1875453495334528:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 269us (580us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788572281.927467:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788572281.965847:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518393600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572281.965916:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572281.972001:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518393600 00000100:00100000:0.0:1788572281.972017:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518393600 00000100:00100000:0.0:1788572281.972128:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788572281.972140:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518393600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572281.972180:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572281.972337:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518393600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (6420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572281.972344:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572281.972666:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518393600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788572281.972812:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788572282.026365:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788572282.198924:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572282.199124:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572282.199166:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572282.199197:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572282.199229:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572282.199362:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495334656 00000100:00100000:2.0:1788572282.199371:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495334656 00000100:00100000:2.0:1788572282.199421:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:2.0:1788572282.199432:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:2355:x1875453495334656:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572282.199536:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:2355:x1875453495334656:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 105us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572282.199544:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:3.0:1788572282.200326:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495334784 00000100:00100000:3.0:1788572282.200332:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495334784 00000100:00100000:3.0:1788572282.200376:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495335040 00000100:00100000:3.0:1788572282.200379:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495335040 00000100:00100000:3.0:1788572282.200394:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495334912 00000100:00100000:3.0:1788572282.200397:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495334912 00000100:00100000:3.0:1788572282.200408:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495335168 00000100:00100000:3.0:1788572282.200411:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495335168 00000100:00100000:3.0:1788572282.200426:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788572282.200434:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2355:x1875453495334784:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572282.200492:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2355:x1875453495334784:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 58us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572282.200506:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1788572282.200877:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788572282.200886:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2355:x1875453495335040:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572282.200924:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2355:x1875453495335040:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 41us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.200931:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788572282.201206:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788572282.201215:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2355:x1875453495334912:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572282.201346:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2355:x1875453495334912:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 132us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.201354:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788572282.201367:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788572282.201374:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c075da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2355:x1875453495335168:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788572282.201399:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c075da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2355:x1875453495335168:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.201421:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00080000:2.0:1788572282.203759:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572282.203780:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572282.345544:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572282.345657:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495335424 00000100:00100000:0.0:1788572282.345719:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495335424 00000100:00100000:0.0:1788572282.345815:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:0.0:1788572282.345837:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+19:14521:x1875453495335424:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:0.0:1788572282.345867:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572282.345890:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11345 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.347774:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00b6a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.347795:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00b6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.347809:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00b6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572282.347906:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788572282.348199:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b63 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11345 expref: 22 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.348233:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00b6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11345 expref: 21 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.348242:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:0.0:1788572282.348245:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572282.348360:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ba00, rc 0) 00000100:00100000:0.0:1788572282.348452:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+21:14521:x1875453495335424:12345-192.168.202.2@tcp:101:cat.0 Request processed in 2627us (2918us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788572282.348461:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1788572282.355297:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572282.355654:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495335680 00000100:00100000:3.0:1788572282.355675:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495335680 00000100:00100000:3.0:1788572282.355741:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788572282.355751:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+21:14521:x1875453495335680:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:3.0:1788572282.356442:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+22:14521:x1875453495335680:12345-192.168.202.2@tcp:35:cat.0 Request processed in 690us (1193us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788572282.356451:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:2.0:1788572282.358065:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572282.358338:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495335808 00000100:00100000:0.0:1788572282.358348:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495335808 00000100:00100000:0.0:1788572282.358443:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:0.0:1788572282.358454:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+22:2353:x1875453495335808:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572282.358468:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572282.358494:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00b6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11345 expref: 22 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.358512:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:0.0:1788572282.358517:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572282.358572:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+21:2353:x1875453495335808:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 120us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.358579:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:2.0:1788572282.469048:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572282.469163:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495336064 00000100:00100000:1.0:1788572282.469190:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495336064 00000100:00100000:1.0:1788572282.469313:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:1.0:1788572282.469325:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+21:14527:x1875453495336064:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:1.0:1788572282.469352:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572282.469379:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b78 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1134c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572282.469486:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00b7f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572282.469502:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00b7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572282.469514:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00b7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572282.469525:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788572282.469683:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994600/0x977d9e7969c00b78 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1134c expref: 24 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572282.469702:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00b7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1134c expref: 23 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572282.469710:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:1.0:1788572282.469713:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572282.469717:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076994000, rc 0) 00000100:00100000:1.0:1788572282.469775:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+23:14527:x1875453495336064:12345-192.168.202.2@tcp:101:dd.0 Request processed in 453us (738us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788572282.469783:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:3.0:1788572282.474400:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572282.474472:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495336320 00000100:00100000:2.0:1788572282.474482:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495336320 00000100:00100000:2.0:1788572282.474550:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1788572282.474572:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+23:14527:x1875453495336320:12345-192.168.202.2@tcp:36:dd.0 00010000:00010000:2.0:1788572282.474632:0:15283:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788572282.474655:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994000/0x977d9e7969c00b7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1134c expref: 23 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.474672:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00b32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11330 expref: 22 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.474681:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:2.0:1788572282.474685:0:15283:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572282.474858:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.474868:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.474876:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572282.474910:0:15283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788572282.474942:0:15283:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f5da25b reply state 00000000eeb45620 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572282.474971:0:15283:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572282.475070:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+24:14527:x1875453495336320:12345-192.168.202.2@tcp:36:dd.0 Request processed in 509us (680us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788572282.475078:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000020:00080000:2.0:1788572282.475083:0:15283:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788572282.475624:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572282.475641:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518393728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572282.475691:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572282.476155:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518394240:0@lo:400:kworker.0 00000100:00100000:0.0:1788572282.476193:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572282.476230:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572282.476236:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518394112:0@lo:400:kworker.0 00000100:00100000:0.0:1788572282.476280:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572282.476310:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518393728 00000100:00100000:0.0:1788572282.476316:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518393728 00000100:00100000:0.0:1788572282.476380:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788572282.476388:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518393728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572282.476417:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788572282.476464:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518393728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.476471:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788572282.476495:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572282.476531:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518393728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572282.476553:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518394240 00000100:00100000:0.0:1788572282.476556:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518394240 00000100:00080000:0.0:1788572282.476571:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572282.476590:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518394112 00000100:00100000:0.0:1788572282.476593:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518394112 00000100:00100000:0.0:1788572282.476609:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788572282.476615:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518394240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572282.476653:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875453518394240:12345-0@lo:400:kworker.0 Request processed in 38us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.476660:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788572282.476684:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1875453518394240:0@lo:400:kworker.0 00000100:00100000:0.0:1788572282.476702:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788572282.476709:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518394112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572282.476739:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518394112:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.476746:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788572282.476767:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518394112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572282.477148:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf634c0e-dd8a-4982-ad2a-0f984621b961:3299:1875453518393856:0@lo:400:kworker.0 00000100:00100000:3.0:1788572282.477173:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572282.477200:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518394368:0@lo:400:kworker.0 00000100:00100000:3.0:1788572282.477228:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572282.477245:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572282.477285:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c075da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518393984:0@lo:400:kworker.0 00000100:00100000:0.0:1788572282.477300:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518393856 00000100:00100000:0.0:1788572282.477304:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518393856 00000100:00100000:3.0:1788572282.477319:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572282.477329:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788572282.477337:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3299:x1875453518393856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572282.477389:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3299:x1875453518393856:12345-0@lo:400:kworker.0 Request processed in 54us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.477397:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788572282.477422:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518394368 00000100:00100000:0.0:1788572282.477425:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518394368 00000100:00080000:0.0:1788572282.477441:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572282.477462:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788572282.477467:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518394368:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1788572282.477488:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.477499:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.477508:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.477514:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572282.477518:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.477526:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.477542:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:2.0:1788572282.477545:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572282.477550:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572282.477555:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00b8d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572282.477607:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518394368:12345-0@lo:400:kworker.0 Request processed in 139us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.477613:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788572282.477846:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf634c0e-dd8a-4982-ad2a-0f984621b961:3299:1875453518393856:0@lo:400:kworker.0 00000100:00100000:3.0:1788572282.477859:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518394368:0@lo:400:kworker.0 00000100:00100000:2.0:1788572282.479272:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518393984 00000100:00100000:2.0:1788572282.479296:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518393984 00000100:00100000:2.0:1788572282.479362:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788572282.479372:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518393984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572282.479450:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518393984:12345-0@lo:400:kworker.0 Request processed in 80us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572282.479457:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788572282.481768:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c075da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518393984:0@lo:400:kworker.0 00010000:00010000:2.0:1788572282.539605:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572282.661935:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572282.662324:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495336576 00000100:00100000:1.0:1788572282.662336:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495336576 00000100:00100000:1.0:1788572282.662395:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788572282.662407:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+23:14527:x1875453495336576:12345-192.168.202.2@tcp:35:dd.0 00000100:00100000:1.0:1788572282.662748:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+24:14527:x1875453495336576:12345-192.168.202.2@tcp:35:dd.0 Request processed in 342us (821us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1788572282.662756:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1788572282.952697:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572282.952937:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495336704 00000100:00100000:0.0:1788572282.952994:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495336704 00000100:00100000:0.0:1788572282.953105:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:0.0:1788572282.953117:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+24:14541:x1875453495336704:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:0.0:1788572282.953140:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572282.953162:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00b94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11353 expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953244:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953302:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953315:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953330:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953353:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953360:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953469:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00ba9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953478:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953485:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572282.953521:0:15283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788572282.953525:0:15283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788572282.953581:0:15283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953594:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953602:0:15283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953609:0:15283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953616:0:15283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953630:0:15283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b400 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572282.953635:0:15283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953642:0:15283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953654:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058eac900) 00010000:00010000:0.0:1788572282.953657:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572282.953662:0:15283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953668:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00b9b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953684:0:15283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953690:0:15283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953695:0:15283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.953700:0:15283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024b200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572282.953703:0:15283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.954102:0:15283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.954121:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88c0481bf400) 00010000:00010000:0.0:1788572282.954123:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572282.954127:0:15283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.954133:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00ba2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.954167:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00b94 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11353 expref: 26 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.954179:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11353 expref: 25 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572282.954186:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:0.0:1788572282.954188:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572282.954191:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b600, rc 0) 00000100:00100000:0.0:1788572282.954376:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+25:14541:x1875453495336704:12345-192.168.202.2@tcp:101:stat.0 Request processed in 1260us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572282.954383:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:2.0:1788572283.071601:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572283.071696:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495336960 00000100:00100000:0.0:1788572283.071717:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495336960 00000100:00100000:0.0:1788572283.071784:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1788572283.071794:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+25:14547:x1875453495336960:12345-192.168.202.2@tcp:36:truncate.0 00010000:00010000:0.0:1788572283.071854:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572283.071883:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00ba9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11353 expref: 25 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.071926:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:0.0:1788572283.071932:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788572283.072430:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788572283.072612:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.072627:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.072637:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788572283.072686:0:14361:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1788572283.072767:0:14361:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8bc5f7a reply state 00000000b5c16361 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572283.072777:0:14361:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572283.072990:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+27:14547:x1875453495336960:12345-192.168.202.2@tcp:36:truncate.0 Request processed in 1195us (1396us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788572283.072998:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000020:00080000:0.0:1788572283.073003:0:14361:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572283.078653:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.078674:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.078682:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.078688:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024ba00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572283.078694:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.078701:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.078728:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:2.0:1788572283.078731:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572283.078736:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.078761:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00bb0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572283.302814:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572283.302912:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495337088 00000100:00100000:3.0:1788572283.302923:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495337088 00000100:00100000:3.0:1788572283.302981:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:3.0:1788572283.302992:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+26:14561:x1875453495337088:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:3.0:1788572283.303014:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572283.303034:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00bb7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1135a expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303098:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303112:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303126:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303156:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303164:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303170:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303328:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303337:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303344:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572283.303377:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788572283.303381:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788572283.303400:0:14362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303411:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303430:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303443:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303449:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303454:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572283.303458:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303465:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303483:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058eac900) 00010000:00010000:3.0:1788572283.303487:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572283.303491:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303498:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00bbe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303513:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303519:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303525:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303530:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572283.303533:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303539:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303546:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88c058907100) 00010000:00010000:3.0:1788572283.303549:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572283.303551:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303557:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00bc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303596:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00bb7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1135a expref: 28 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303609:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1135a expref: 27 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.303617:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:3.0:1788572283.303618:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572283.303621:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4d600, rc 0) 00000100:00100000:3.0:1788572283.303677:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+27:14561:x1875453495337088:12345-192.168.202.2@tcp:101:stat.0 Request processed in 687us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572283.303684:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1788572283.476058:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572283.476290:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495337344 00000100:00100000:2.0:1788572283.476300:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495337344 00000100:00100000:2.0:1788572283.476353:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1788572283.476360:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+27:14571:x1875453495337344:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788572283.476378:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572283.476397:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c00bd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11361 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572283.476482:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788572283.476594:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c00bd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11361 expref: 29 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.476609:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:2.0:1788572283.476612:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572283.476618:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c00bd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11361 expref: 29 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.476633:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c800, rc 0) 00000100:00100000:2.0:1788572283.476705:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+28:14571:x1875453495337344:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 344us (659us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788572283.476712:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1788572283.481128:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572283.481202:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495337600 00000100:00100000:1.0:1788572283.481220:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495337600 00000100:00100000:1.0:1788572283.481388:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788572283.481397:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0591b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+28:14571:x1875453495337600:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788572283.483637:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0591b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+29:14571:x1875453495337600:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 2234us (2509us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788572283.483647:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00010000:00010000:1.0:1788572283.560532:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572283.574608:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572283.574749:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495337856 00000100:00100000:2.0:1788572283.574772:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495337856 00000100:00100000:2.0:1788572283.574832:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:2.0:1788572283.574843:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+29:14577:x1875453495337856:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788572283.574866:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572283.574886:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c00be1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11368 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.574979:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.574994:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11329 expref: 30 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.575004:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1135a expref: 30 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.575012:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.575046:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1135a expref: 30 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.575060:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1135a expref: 30 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572283.575074:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875453518394496:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572283.575196:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11329 expref: 30 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.575227:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11329 expref: 30 pid: 14361 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572283.575237:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875453518394624:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572283.575308:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572283.581694:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572283.581790:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572283.581885:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495338112 00000100:00100000:0.0:1788572283.581894:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495338112 00010000:00010000:0.0:1788572283.581932:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11329 expref: 31 pid: 14361 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572283.581967:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495337984 00000100:00100000:0.0:1788572283.581970:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495337984 00010000:00010000:0.0:1788572283.581984:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1135a expref: 32 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572283.582018:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788572283.582028:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c058efc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:2356:x1875453495338112:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572283.582043:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572283.582051:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11329 expref: 32 pid: 14361 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.582063:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11329 expref: 32 pid: 14361 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.582095:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:0.0:1788572283.582101:0:14348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.582109:0:14348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.582117:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572283.582178:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c058efc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:2356:x1875453495338112:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 151us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572283.582184:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788572283.582246:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1788572283.582281:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:2356:x1875453495337984:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572283.582289:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572283.582293:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1135a expref: 31 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.582312:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1135a expref: 31 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.582323:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:0.0:1788572283.582326:0:14348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.582334:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.582342:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.582358:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572283.582376:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:2356:x1875453495337984:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 97us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572283.582382:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00010000:00010000:2.0:1788572283.583512:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d600/0x977d9e7969c00bcc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1135a expref: 30 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572283.583532:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875453518394496:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572283.583545:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d200/0x977d9e7969c00b1d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11329 expref: 29 pid: 14361 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572283.583555:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875453518394624:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572283.583578:0:14362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.583586:0:14362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.583592:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572283.583611:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788572283.583769:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c800/0x977d9e7969c00be1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11368 expref: 30 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.583800:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11368 expref: 29 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.583809:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:2.0:1788572283.583812:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788572283.583815:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0d800, rc 0) 00000100:00100000:2.0:1788572283.583872:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+29:14577:x1875453495337856:12345-192.168.202.2@tcp:101:bash.0 Request processed in 9031us (9274us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1788572283.583880:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:3.0:1788572283.588615:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572283.588822:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495338368 00000100:00100000:2.0:1788572283.588832:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495338368 00000100:00100000:2.0:1788572283.588883:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:2.0:1788572283.588893:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07667ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+29:14577:x1875453495338368:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:2.0:1788572283.589614:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.589632:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.589643:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572283.589695:0:14363:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788572283.589732:0:14363:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cd3089e reply state 000000002e6b151f transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572283.589741:0:14363:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788572283.589841:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07667ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:14577:x1875453495338368:12345-192.168.202.2@tcp:36:bash.0 Request processed in 948us (1233us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788572283.589847:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000020:00080000:2.0:1788572283.589852:0:14363:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572283.594531:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.594547:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.594554:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.594559:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:2.0:1788572283.594563:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.594571:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.594588:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:2.0:1788572283.594591:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572283.594596:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.594602:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0ce00/0x977d9e7969c00bf6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572283.595538:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572283.602047:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495338496 00000100:00100000:0.0:1788572283.602062:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495338496 00000100:00100000:0.0:1788572283.602184:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1788572283.602196:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:14577:x1875453495338496:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572283.602229:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572283.602275:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00bfd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1136f expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.602333:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00bfd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1136f expref: 32 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.602367:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00bfd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1136f expref: 32 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.602388:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:0.0:1788572283.602391:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572283.602394:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b200, rc 0) 00000100:00100000:0.0:1788572283.602577:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:14577:x1875453495338496:12345-192.168.202.2@tcp:101:bash.0 Request processed in 382us (7044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572283.602584:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:2.0:1788572283.613303:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572283.613446:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495338624 00000100:00100000:1.0:1788572283.613456:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495338624 00000100:00100000:1.0:1788572283.613505:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:1.0:1788572283.613514:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:14577:x1875453495338624:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788572283.613534:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572283.613555:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00c04 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11376 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572283.613646:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572283.613661:0:14363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11368 expref: 33 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572283.613671:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572283.613704:0:14363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11368 expref: 33 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572283.613728:0:14363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11368 expref: 33 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572283.613742:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd10700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14363:1875453518394752:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788572283.613823:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788572283.616284:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd10700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14363:1875453518394752:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572283.616285:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:1.0:1788572283.616310:0:14363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572283.616352:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495338752 00000100:00100000:0.0:1788572283.616359:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495338752 00010000:00010000:0.0:1788572283.616393:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11368 expref: 34 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572283.616431:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1788572283.616445:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+34:2356:x1875453495338752:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572283.616458:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572283.616465:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11368 expref: 34 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.616476:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11368 expref: 34 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.616497:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d800/0x977d9e7969c00be8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11368 expref: 34 pid: 14362 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.616527:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:0.0:1788572283.616531:0:14348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.616540:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.616547:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.616577:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572283.616625:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+33:2356:x1875453495338752:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 181us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572283.616631:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00010000:00010000:2.0:1788572283.617287:0:14363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.617309:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572283.617358:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788572283.617362:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572283.617382:0:14363:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.617413:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994e00/0x977d9e7969c00c04 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11376 expref: 33 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.617429:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11376 expref: 32 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572283.617447:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:2.0:1788572283.617449:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572283.617452:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c076995600, rc 0) 00000100:00100000:2.0:1788572283.617489:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:14577:x1875453495338624:12345-192.168.202.2@tcp:101:bash.0 Request processed in 3976us (4194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572283.617497:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1788572283.620697:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572283.620772:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495339008 00000100:00100000:3.0:1788572283.620781:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495339008 00000100:00100000:3.0:1788572283.620848:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:3.0:1788572283.620858:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:14577:x1875453495339008:12345-192.168.202.2@tcp:103:bash.0 00010000:00010000:3.0:1788572283.620872:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788572283.620896:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11376 expref: 32 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.620917:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00bfd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1136f expref: 31 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.620943:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907600) 00010000:00010000:3.0:1788572283.620954:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572283.621062:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+30:14577:x1875453495339008:12345-192.168.202.2@tcp:103:bash.0 Request processed in 205us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572283.621070:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1788572283.625416:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572283.625686:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495339136 00000100:00100000:3.0:1788572283.625697:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495339136 00000100:00100000:3.0:1788572283.625754:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1788572283.625764:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+30:14577:x1875453495339136:12345-192.168.202.2@tcp:58:bash.0 00010000:00010000:3.0:1788572283.625871:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.625887:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572283.625899:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572283.627003:0:14362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572283.627981:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788572283.628056:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788572283.628215:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+30:14577:x1875453495339136:12345-192.168.202.2@tcp:58:bash.0 Request processed in 2438us (2795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572283.628226:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:1.0:1788572283.640634:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572283.640794:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495339264 00000100:00100000:0.0:1788572283.640804:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495339264 00000100:00100000:0.0:1788572283.640902:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1788572283.640913:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+30:14577:x1875453495339264:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572283.640931:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572283.640952:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00c19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1137d expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.641006:0:14361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.641018:0:14361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00c19 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1137d expref: 31 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.641055:0:14361:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.641069:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00c19 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1137d expref: 31 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.641083:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907100) 00010000:00010000:0.0:1788572283.641085:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572283.641089:0:14361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00c19 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1137d expref: 31 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572283.641097:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b400, rc 0) 00000100:00100000:0.0:1788572283.641157:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:14577:x1875453495339264:12345-192.168.202.2@tcp:101:bash.0 Request processed in 246us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572283.641164:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000040:00080000:1.0:1788572284.072535:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788572284.072544:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788572284.072582:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788572284.072590:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788572284.072713:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd11f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14393:1875453518394880:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788572284.072850:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff88bf452cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572284.076005:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd11f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14393:1875453518394880:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788572284.080061:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572284.080648:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495339392 00000100:00100000:2.0:1788572284.080661:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495339392 00000100:00100000:2.0:1788572284.080728:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1788572284.080740:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:14578:x1875453495339392:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788572284.081519:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:14578:x1875453495339392:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 Request processed in 780us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572284.081696:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788572284.088059:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.088143:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495339520 00000100:00100000:0.0:1788572284.088152:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495339520 00000100:00100000:0.0:1788572284.088210:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1788572284.088219:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:14578:x1875453495339520:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788572284.088334:0:15283:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788572284.088561:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:14578:x1875453495339520:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 341us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.088568:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:2.0:1788572284.098698:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572284.098779:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495339648 00000100:00100000:1.0:1788572284.098790:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495339648 00000100:00100000:1.0:1788572284.098843:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:1.0:1788572284.098853:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:14578:x1875453495339648:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788572284.098932:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.098949:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.098962:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.098994:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099003:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099009:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099032:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099041:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099047:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572284.099098:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788572284.099103:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788572284.099118:0:14363:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099135:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099141:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099149:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099155:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572284.099160:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099168:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099179:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:1.0:1788572284.099182:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572284.099187:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099193:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c20 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099213:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099228:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099234:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099240:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572284.099276:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099283:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099292:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff88c058eaca00) 00010000:00010000:1.0:1788572284.099295:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572284.099298:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099304:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c27 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099318:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099324:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099329:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099333:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572284.099344:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099350:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099358:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907100) 00010000:00010000:1.0:1788572284.099360:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572284.099363:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.099368:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995a00/0x977d9e7969c00c2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572284.101480:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:14578:x1875453495339648:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 2618us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572284.101492:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:1.0:1788572284.109866:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572284.110613:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495339904 00000100:00100000:3.0:1788572284.110650:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495339904 00000100:00100000:3.0:1788572284.110711:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:3.0:1788572284.110722:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+31:14578:x1875453495339904:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572284.110741:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572284.110761:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00c35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11384 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.110867:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.110883:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.110894:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572284.110905:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788572284.111001:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.111007:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.111014:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.111020:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572284.111024:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.111031:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.111049:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907100) 00010000:00010000:3.0:1788572284.111051:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572284.111056:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.112213:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00c3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.112402:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00c35 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11384 expref: 33 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.112416:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88c0481bf700) 00010000:00010000:3.0:1788572284.112419:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788572284.112423:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4c800/0x977d9e7969c00c35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11384 expref: 33 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.113114:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4c800, rc 0) 00000100:00100000:3.0:1788572284.114792:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:14578:x1875453495339904:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4063us (4929us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1788572284.114805:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:3.0:1788572284.128528:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572284.128629:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495340032 00000100:00100000:1.0:1788572284.128639:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495340032 00000100:00100000:1.0:1788572284.128701:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:1.0:1788572284.128711:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:14578:x1875453495340032:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788572284.128744:0:14363:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788572284.128843:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf47694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:14578:x1875453495340032:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 133us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572284.128850:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788572284.145486:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.145804:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495340288 00000100:00100000:0.0:1788572284.145816:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495340288 00000100:00100000:0.0:1788572284.145887:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:0.0:1788572284.145912:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+32:14578:x1875453495340288:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572284.145943:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572284.145964:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c4a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb1138b expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572284.146618:0:15283:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1788572284.146625:0:15283:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788572284.146690:0:15283:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788572284.146964:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00c51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.146980:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00c51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.146992:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00c51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.147044:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c4a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1138b expref: 35 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.147060:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00c51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1138b expref: 34 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.147068:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf400) 00010000:00010000:0.0:1788572284.147071:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572284.147075:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b200, rc 0) 00000100:00100000:0.0:1788572284.147143:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+34:14578:x1875453495340288:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1232us (1668us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788572284.147150:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:3.0:1788572284.154574:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572284.154683:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495340544 00000100:00100000:1.0:1788572284.154693:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495340544 00000100:00100000:1.0:1788572284.154749:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1788572284.154760:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf476b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+34:14578:x1875453495340544:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788572284.154829:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572284.154855:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00c51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1138b expref: 34 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.154876:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf400) 00010000:00010000:1.0:1788572284.154886:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572284.154909:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.154922:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.154945:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.154961:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.154968:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.154977:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155040:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155048:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155054:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155067:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994a00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572284.155072:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155080:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155089:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058eac900) 00010000:00010000:1.0:1788572284.155093:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572284.155097:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155104:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00c5f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155114:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155120:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155125:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155130:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:1.0:1788572284.155133:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155140:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155159:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb241f3e (ffff88c058eaca00) 00010000:00010000:1.0:1788572284.155162:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572284.155165:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.155171:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995200/0x977d9e7969c00c66 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb241f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572284.155297:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf476b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+33:14578:x1875453495340544:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 538us (732us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572284.155304:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1788572284.161477:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.161538:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495340672 00000100:00100000:0.0:1788572284.161547:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495340672 00000100:00100000:0.0:1788572284.161591:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:0.0:1788572284.161600:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+33:14578:x1875453495340672:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572284.161619:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572284.161640:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00c6d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11392 expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.161671:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00c74 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.161684:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00c74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.161695:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00c74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.161792:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b600/0x977d9e7969c00c6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11392 expref: 35 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.161811:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024ba00/0x977d9e7969c00c74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11392 expref: 34 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.161819:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:0.0:1788572284.161822:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788572284.161826:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024ba00, rc 0) 00000100:00100000:0.0:1788572284.161884:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+34:14578:x1875453495340672:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 285us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.161891:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1788572284.164217:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572284.164368:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495340928 00000100:00100000:1.0:1788572284.164377:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495340928 00000100:00100000:1.0:1788572284.164433:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:1.0:1788572284.164443:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+34:14578:x1875453495340928:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788572284.164518:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.164532:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.164541:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572284.164917:0:14363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788572284.165019:0:14363:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 504955769319ns, next at 505955766207ns, rc = 0 00000004:00010000:1.0:1788572284.165101:0:14363:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008625d166 reply state 00000000423c9d36 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572284.165121:0:14363:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572284.165219:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+36:14578:x1875453495340928:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 777us (1018us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788572284.165226:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00010000:00010000:3.0:1788572284.167109:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.167125:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.167148:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.167154:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076995600 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572284.167159:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.167167:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.167183:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:3.0:1788572284.167186:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788572284.167191:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.167210:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076995600/0x977d9e7969c00c7b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572284.169919:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.182805:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495341056 00000100:00100000:0.0:1788572284.182821:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495341056 00000100:00100000:0.0:1788572284.183061:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:0.0:1788572284.183074:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+35:14578:x1875453495341056:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788572284.183097:0:15283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572284.183120:0:15283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb11399 expref: -99 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.183186:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11399 expref: 36 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.183235:0:15283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11399 expref: 36 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.183297:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:0.0:1788572284.183301:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572284.183305:0:15283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024a000, rc 0) 00000100:00100000:0.0:1788572284.183379:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+36:14578:x1875453495341056:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 308us (13469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.183386:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:1.0:1788572284.194001:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572284.194114:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495341184 00000100:00100000:3.0:1788572284.194125:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495341184 00000100:00100000:3.0:1788572284.194196:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788572284.194216:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2355:x1875453495341184:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788572284.194367:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572284.194941:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:2355:x1875453495341184:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 724us (946us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788572284.194949:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1788572284.208548:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572284.208701:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495341440 00000100:00100000:3.0:1788572284.208712:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495341440 00000100:00100000:3.0:1788572284.208791:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1788572284.208802:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+36:14578:x1875453495341440:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788572284.209062:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+37:14578:x1875453495341440:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 260us (523us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788572284.209070:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788572284.213863:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.213967:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495341696 00000100:00100000:0.0:1788572284.213976:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495341696 00000100:00100000:0.0:1788572284.214037:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:0.0:1788572284.214047:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+37:14578:x1875453495341696:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788572284.214165:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+37:14578:x1875453495341696:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 118us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.214173:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:0.0:1788572284.225657:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572284.225738:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495341824 00000100:00100000:3.0:1788572284.225748:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495341824 00000100:00100000:3.0:1788572284.225805:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:3.0:1788572284.225815:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+37:14578:x1875453495341824:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572284.225939:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572284.226351:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4de00/0x977d9e7969c00c89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb113a0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.227938:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00c90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.227959:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00c90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.227973:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00c90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572284.228018:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788572284.228036:0:14362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00c90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.228069:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4de00/0x977d9e7969c00c89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a0 expref: 39 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.228086:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00c90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a0 expref: 38 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.228094:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:2.0:1788572284.228097:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788572284.228100:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c400, rc 0) 00000100:00100000:2.0:1788572284.228393:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+38:14578:x1875453495341824:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2578us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572284.228419:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:0.0:1788572284.232752:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572284.232814:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495341952 00000100:00100000:3.0:1788572284.232834:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495341952 00000100:00100000:3.0:1788572284.232886:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1788572284.232896:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+6:2355:x1875453495341952:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788572284.232915:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572284.232945:0:15044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb113a7 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572284.232973:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b727c, blocks: 0x1 00010000:00010000:3.0:1788572284.232992:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=505s v=(0 0) 00010000:00010000:3.0:1788572284.232996:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572284.233006:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a7 expref: 7 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.233048:0:15044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a7 expref: 7 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.233061:0:15044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c052e4c800, rc 0) 00000100:00100000:3.0:1788572284.235717:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:2355:x1875453495341952:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2810us (2963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572284.235729:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1788572284.250112:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572284.250282:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495342208 00000100:00100000:1.0:1788572284.250291:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495342208 00000100:00100000:1.0:1788572284.250347:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1788572284.250357:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+38:14578:x1875453495342208:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788572284.250460:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+38:14578:x1875453495342208:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 104us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572284.250468:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1788572284.265176:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.265330:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495342336 00000100:00100000:0.0:1788572284.265344:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495342336 00000100:00100000:0.0:1788572284.265412:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:0.0:1788572284.265424:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+38:14578:x1875453495342336:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788572284.375888:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+38:14578:x1875453495342336:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 110457us (110713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572284.375901:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000001:00080000:0.0:1788572284.376098:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:0.0:1788572284.376119:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1788572284.376127:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:0.0:1788572284.376131:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788572284.376166:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:0.0:1788572284.376332:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572284.376348:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518395008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788572284.376402:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572284.376598:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518395008 00000100:00100000:0.0:1788572284.376606:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518395008 00000100:00100000:0.0:1788572284.376658:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788572284.376667:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88bf46a64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518395008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788572284.380125:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572284.380170:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788572284.380179:0:15044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00010000:0.0:1788572284.381103:0:15043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788572284.381109:0:15043:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788572284.381112:0:15043:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788572284.381114:0:15043:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788572284 -> 1788572284 00002000:00010000:0.0:1788572284.381125:0:15043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788572284.381209:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88bf46a64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875453518395008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4530us (4794us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788572284.381222:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788572284.381278:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495342464 00000100:00100000:0.0:1788572284.381300:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495342464 00000100:00100000:0.0:1788572284.381336:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1788572284.381345:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:2355:x1875453495342464:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1788572284.381665:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572284.383380:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:2355:x1875453495342464:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 2025us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.383392:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000004:00080000:3.0:1788572284.383948:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88bf46a66300/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788572284.383956:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518395008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788572284.390240:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.390910:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495342720 00000100:00100000:0.0:1788572284.390921:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495342720 00000100:00100000:0.0:1788572284.390996:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1788572284.391007:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+13:14578:x1875453495342720:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788572284.391069:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572284.391097:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0c400/0x977d9e7969c00c90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a0 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.391117:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:0.0:1788572284.391122:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572284.391651:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.391667:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.391677:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572284.391896:0:14361:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053952ac9 reply state 0000000031c95996 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572284.391905:0:14361:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572284.392037:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+14:14578:x1875453495342720:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1031us (1807us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788572284.392045:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00010000:00010000:0.0:1788572284.399220:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.399238:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.399282:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.399289:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024be00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572284.399293:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.399301:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.399317:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:0.0:1788572284.399320:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.399325:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.399330:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00c9e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572284.404312:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572284.404407:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495342848 00000100:00100000:2.0:1788572284.404416:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495342848 00000100:00100000:2.0:1788572284.404479:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788572284.404490:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:14578:x1875453495342848:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788572284.404509:0:15045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572284.404528:0:15045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb113ae expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.404560:0:15045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a7 expref: 8 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.404569:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572284.404574:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572284.404579:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 8 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.404613:0:15045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a7 expref: 8 pid: 15044 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.404626:0:15045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a7 expref: 8 pid: 15044 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572284.404655:0:15045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15045:1875453518395136:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572284.404741:0:15045:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572284.409298:0:15045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15045:1875453518395136:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572284.409338:0:15045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 8 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.409384:0:15045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c058a0c400, rc 0) 00000100:00100000:0.0:1788572284.409454:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+8:14578:x1875453495342848:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4965us (5151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.409463:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1788572284.412651:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572284.412807:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495342976 00000100:00100000:1.0:1788572284.412818:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495342976 00010000:00010000:1.0:1788572284.412866:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a7 expref: 8 pid: 15044 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572284.412910:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:1.0:1788572284.412930:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+8:2355:x1875453495342976:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572284.412945:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572284.412966:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a7 expref: 8 pid: 15044 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.413000:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a7 expref: 8 pid: 15044 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.413022:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008af00ea1/0x977d9e7969c00c97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113a7 expref: 8 pid: 15044 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.413039:0:14346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572284.413043:0:14346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572284.413049:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 7 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.413058:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 7 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.413096:0:14346:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 7 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572284.413111:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07fd10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14346:1875453518395264:192.168.202.2@tcp:105: 00000100:00100000:1.0:1788572284.413209:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c050342e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572284.417409:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572284.417557:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07fd10000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14346:1875453518395264:192.168.202.2@tcp:105: 00010000:00010000:1.0:1788572284.417581:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572284.417643:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:2355:x1875453495342976:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 4723us (4999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572284.417672:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:0.0:1788572284.417796:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495343104 00000100:00100000:0.0:1788572284.417804:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495343104 00000100:00100000:0.0:1788572284.417871:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1788572284.417881:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:2355:x1875453495343104:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788572284.418093:0:15044:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788572284.418097:0:15044:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788572283 00002000:00010000:0.0:1788572284.418099:0:15044:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788572281 00002000:00010000:0.0:1788572284.418102:0:15044:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788572284 -> 1788572283 00002000:00010000:0.0:1788572284.418104:0:15044:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788572284.418132:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+8:2355:x1875453495343104:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 253us (733us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788572284.418139:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1788572284.422580:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.422734:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495343232 00000100:00100000:0.0:1788572284.422744:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495343232 00000100:00100000:0.0:1788572284.422808:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:0.0:1788572284.422819:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+8:2356:x1875453495343232:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788572284.422875:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.422896:0:15043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 8 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.422917:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572284.422933:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788572284.422939:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.422979:0:15043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 8 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.422993:0:15043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 8 pid: 15045 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572284.423010:0:15043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88bf46a65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15043:1875453518395392:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788572284.423095:0:15043:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c0512119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572284.426490:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572284.426630:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495343360 00000100:00100000:1.0:1788572284.426639:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495343360 00010000:00010000:1.0:1788572284.426679:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 9 pid: 15045 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572284.426720:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1788572284.426729:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:2356:x1875453495343360:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572284.426743:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572284.426766:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 9 pid: 15045 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.426780:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 9 pid: 15045 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.426804:0:14348:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788572284.426808:0:14348:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788572284.426814:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.426833:0:14348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.426854:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572284.426906:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+9:2356:x1875453495343360:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 178us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572284.426937:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00010000:00010000:0.0:1788572284.427681:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ff406f/0x977d9e7969c00ca5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113ae expref: 8 pid: 15045 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572284.427698:0:15043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88bf46a65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15043:1875453518395392:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788572284.427720:0:15043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.427732:0:15043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.427739:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.427775:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.427785:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.427793:0:15043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.427800:0:15043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024be00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:0.0:1788572284.427805:0:15043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.427814:0:15043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.427843:0:15043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.427852:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d20df320/0x977d9e7969c00cac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572284.427915:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:2356:x1875453495343232:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 5098us (5347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.427948:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788572284.432357:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572284.432552:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495343616 00000100:00100000:2.0:1788572284.432563:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495343616 00000100:00100000:2.0:1788572284.432627:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:2.0:1788572284.432637:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+13:14578:x1875453495343616:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788572284.432719:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.432737:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.432750:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.433016:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.433029:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11399 expref: 14 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.433036:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.433068:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11399 expref: 14 pid: 15283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.433091:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11399 expref: 14 pid: 15283 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572284.433106:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875453518395520:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788572284.433219:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572284.436239:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572284.436424:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495343744 00000100:00100000:3.0:1788572284.436443:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495343744 00010000:00010000:3.0:1788572284.436479:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11399 expref: 15 pid: 15283 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572284.436520:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1788572284.436530:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+15:2355:x1875453495343744:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788572284.436560:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572284.436567:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11399 expref: 15 pid: 15283 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.436581:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11399 expref: 15 pid: 15283 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.436601:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:3.0:1788572284.436607:0:14346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.436616:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.436624:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.436643:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572284.436703:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+15:2355:x1875453495343744:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 175us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572284.436711:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00010000:00010000:2.0:1788572284.437582:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00c82 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x6d478a807bb11399 expref: 14 pid: 15283 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572284.437601:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875453518395520:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788572284.437620:0:14362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.437629:0:14362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.437634:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788572284.437809:0:14362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788572284.437968:0:14362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788572284.438014:0:14362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788572284.438090:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c07f7f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14362:1875453518395648:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788572284.438194:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572284.438407:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c07635e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788572284.438543:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518395648 00000100:00100000:1.0:1788572284.438550:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518395648 00000100:00100000:1.0:1788572284.438595:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572284.438604:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14362:x1875453518395648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788572284.438683:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14362:x1875453518395648:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572284.438691:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788572284.438882:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c07f7f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14362:1875453518395648:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788572284.439758:0:14362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1788572284.439830:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14362:1875453518395776:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788572284.439885:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572284.439916:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c049bf9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572284.440060:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518395776 00000100:00100000:2.0:1788572284.440066:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518395776 00000100:00100000:2.0:1788572284.440097:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788572284.440114:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14362:x1875453518395776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788572284.440414:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14362:x1875453518395776:12345-0@lo:1000:mdt00_001.0 Request processed in 301us (528us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788572284.440422:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572284.440632:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14362:1875453518395776:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788572284.440664:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440680:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440688:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440694:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0dc00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572284.440699:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440707:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440723:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:3.0:1788572284.440727:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572284.440732:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440738:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0dc00/0x977d9e7969c00cba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440770:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440776:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440781:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440786:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4d000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572284.440795:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440801:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440810:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907100) 00010000:00010000:3.0:1788572284.440813:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788572284.440819:0:14362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00c19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1137d expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440830:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00c19 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1137d expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440840:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00c19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1137d expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.440866:0:14362:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b400/0x977d9e7969c00c19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb1137d expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572284.440878:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875453518395904:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788572284.441168:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff88c04b178c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788572284.446131:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572284.446208:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495343872 00000100:00100000:2.0:1788572284.446217:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495343872 00000100:00100000:2.0:1788572284.446305:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1788572284.446316:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+18:14577:x1875453495343872:12345-192.168.202.2@tcp:49:bash.0 00000100:00100000:2.0:1788572284.446449:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07fd11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+18:14577:x1875453495343872:12345-192.168.202.2@tcp:49:bash.0 Request processed in 135us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572284.446456:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788572284.452185:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875453518395904:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788572284.452238:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452281:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4d000/0x977d9e7969c00c12 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452338:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452352:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452362:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452372:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452379:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452385:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452391:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c052e4ce00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572284.452395:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452402:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452414:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907100) 00010000:00010000:3.0:1788572284.452417:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572284.452420:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452438:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c052e4ce00/0x977d9e7969c00cc1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452460:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452466:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452472:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452477:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c058a0d200 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:3.0:1788572284.452481:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452487:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452494:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907100) 00010000:00010000:3.0:1788572284.452497:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788572284.452500:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.452505:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c058a0d200/0x977d9e7969c00cb3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572284.452740:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+17:14578:x1875453495343616:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 20101us (20389us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788572284.452751:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000020:00080000:3.0:1788572284.452757:0:14362:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788572284.453014:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788572284.453019:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788572284.453044:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788572284.453050:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788572284.453332:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.453726:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495344000 00000100:00100000:0.0:1788572284.453734:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495344000 00000100:00100000:0.0:1788572284.453790:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:0.0:1788572284.453800:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+7:14577:x1875453495344000:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788572284.453816:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572284.453834:0:15044:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c00cc8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb113b5 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572284.453857:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9b727b, atime: 0x6a9b7279, ctime: 0x6a9b727b, blocks: 0x1 00010000:00010000:0.0:1788572284.453874:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788572284.453878:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572284.453887:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c00cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113b5 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.453901:0:15044:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e639824a/0x977d9e7969c00cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113b5 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.453911:0:15044:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b600, rc 0) 00000100:00100000:0.0:1788572284.453948:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+8:14577:x1875453495344000:12345-192.168.202.2@tcp:101:bash.0 Request processed in 150us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.453955:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1788572284.457446:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788572284.457484:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788572284.461767:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495344256 00000100:00100000:1.0:1788572284.461787:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495344256 00000100:00100000:1.0:1788572284.461850:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495344512 00000100:00100000:1.0:1788572284.461854:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495344512 00000100:00100000:1.0:1788572284.461875:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788572284.461885:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+18:14577:x1875453495344256:12345-192.168.202.2@tcp:35:bash.0 00000001:00080000:1.0:1788572284.462140:0:14364:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000001:00080000:1.0:1788572284.462508:0:14364:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:1.0:1788572284.462750:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+21:14577:x1875453495344256:12345-192.168.202.2@tcp:35:bash.0 Request processed in 863us (5322us total) trans 8589934631 rc 0/0 00000100:00100000:1.0:1788572284.462759:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000020:00080000:1.0:1788572284.462764:0:14364:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788572284.462785:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:1.0:1788572284.462793:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+20:14578:x1875453495344512:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788572284.463364:0:14364:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788572284.463969:0:14364:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:1.0:1788572284.464029:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.464050:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.464062:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.464070:0:14364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.464076:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.464082:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.464109:0:14364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572284.464190:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+22:14578:x1875453495344512:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1396us (6703us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1788572284.464212:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000020:00080000:1.0:1788572284.464217:0:14364:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788572284.464607:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572284.464615:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.464622:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c076994a00 already unused, calling callback (ffffffffc14874f0) 00010000:00010000:2.0:1788572284.464626:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.464635:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.464648:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88c0481bf200) 00010000:00010000:2.0:1788572284.464651:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572284.464656:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.464662:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c076994a00/0x977d9e7969c00ccf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.464686:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572284.464687:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572284.464689:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572284.588467:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572284.613523:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.614000:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495344768 00000100:00100000:0.0:1788572284.614009:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495344768 00000100:00100000:0.0:1788572284.614060:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:0.0:1788572284.614067:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+22:14588:x1875453495344768:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788572284.614087:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572284.614105:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00cd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d478a807bb113bc expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572284.614203:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788572284.614360:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00cd6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113bc expref: 24 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.614374:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88c058907900) 00010000:00010000:0.0:1788572284.614377:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788572284.614381:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024b200/0x977d9e7969c00cd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x6d478a807bb113bc expref: 24 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.614393:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88c05024b200, rc 0) 00000100:00100000:0.0:1788572284.614451:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49879c47-62cc-4834-ba47-ea0cc39dfd63+23:14588:x1875453495344768:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 383us (936us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1788572284.614458:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1788572284.622447:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.622565:0:15283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495344896 00000100:00100000:0.0:1788572284.622578:0:15283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495344896 00000100:00100000:0.0:1788572284.622639:0:15283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:0.0:1788572284.622649:0:15283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c07f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+23:14588:x1875453495344896:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1788572284.622728:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.622764:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.622775:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.622792:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.622800:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.622806:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623227:0:15283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623236:0:15283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623244:0:15283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572284.623319:0:15283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623333:0:15283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623339:0:15283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623358:0:15283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623364:0:15283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024a000 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572284.623369:0:15283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623377:0:15283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623390:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88c058eac900) 00010000:00010000:0.0:1788572284.623393:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.623399:0:15283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623405:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024a000/0x977d9e7969c00ce4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623419:0:15283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623425:0:15283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623431:0:15283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623435:0:15283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c05024be00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572284.623438:0:15283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623454:0:15283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623462:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88c0481bfe00) 00010000:00010000:0.0:1788572284.623465:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.623468:0:15283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623474:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c05024be00/0x977d9e7969c00ceb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623489:0:15283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623495:0:15283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623500:0:15283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623505:0:15283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88c040031c00 already unused, calling callback (ffffffffc1ecb4f0) 00010000:00010000:0.0:1788572284.623507:0:15283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623513:0:15283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623519:0:15283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88c058907100) 00010000:00010000:0.0:1788572284.623522:0:15283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.623524:0:15283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.623538:0:15283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88c040031c00/0x977d9e7969c00cf2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572284.623625:0:15283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c07f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49879c47-62cc-4834-ba47-ea0cc39dfd63+23:14588:x1875453495344896:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 975us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.623633:0:15283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:1.0:1788572284.627678:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788572284.629061:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495345152 00000100:00100000:0.0:1788572284.629077:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495345152 00000100:00100000:0.0:1788572284.629149:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1788572284.629160:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+23:14588:x1875453495345152:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788572284.629453:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49879c47-62cc-4834-ba47-ea0cc39dfd63+24:14588:x1875453495345152:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 294us (1783us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1788572284.629462:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00010000:00010000:2.0:1788572285.608560:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572286.490858:0:16627:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788572286.633160:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572287.081417:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518396032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572287.081483:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572287.081602:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518396032 00000100:00100000:2.0:1788572287.081609:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518396032 00000100:00100000:2.0:1788572287.081668:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788572287.081678:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0502ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518396032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572287.081710:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572287.081752:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0502ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875453518396032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.081758:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788572287.081898:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572287.081996:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1875453518396032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572287.321776:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572287.321819:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572287.321847:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572287.321870:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572287.321887:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572287.321901:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572287.321919:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788572287.321941:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495345536 00000100:00100000:2.0:1788572287.321950:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495345536 00000100:00100000:2.0:1788572287.322000:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495346048 00000100:00100000:2.0:1788572287.322003:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495346048 00000100:00100000:2.0:1788572287.322015:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495345664 00000100:00100000:2.0:1788572287.322017:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495345664 00000100:00100000:2.0:1788572287.322037:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495345920 00000100:00100000:2.0:1788572287.322045:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495345920 00000100:00100000:2.0:1788572287.322063:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788572287.322072:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2356:x1875453495345536:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572287.322146:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+5:2356:x1875453495345536:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 74us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.322153:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788572287.322170:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788572287.322187:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2356:x1875453495346048:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572287.322208:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2356:x1875453495346048:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.322214:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788572287.322234:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1788572287.322240:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+8:2356:x1875453495345664:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572287.322289:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+8:2356:x1875453495345664:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.322296:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1788572287.322305:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788572287.322311:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2356:x1875453495345920:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788572287.322328:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+5:2356:x1875453495345920:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 17us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.322333:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00080000:2.0:1788572287.322355:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572287.322359:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572287.322951:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495345280 00000100:00100000:3.0:1788572287.322958:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495345280 00000100:00100000:3.0:1788572287.322999:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:3.0:1788572287.323006:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:2356:x1875453495345280:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572287.323044:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076491050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:521ca3eb-db2d-45f5-993b-8b7ccd79f40d+13:2356:x1875453495345280:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 39us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572287.323050:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:3.0:1788572287.323077:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495345792 00000100:00100000:3.0:1788572287.323080:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495345792 00000100:00100000:3.0:1788572287.323122:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453495345408 00000100:00100000:3.0:1788572287.323125:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453495345408 00000100:00100000:3.0:1788572287.323143:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788572287.323149:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:2356:x1875453495345792:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572287.323188:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db5b294e-3ec6-4d91-9e97-6404d5f30cf6+6:2356:x1875453495345792:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 39us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572287.323194:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788572287.323206:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1788572287.323211:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+24:2356:x1875453495345408:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788572287.323606:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49879c47-62cc-4834-ba47-ea0cc39dfd63+24:2356:x1875453495345408:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 393us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572287.323613:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00080000:3.0:1788572287.323634:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572287.599710:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c0764a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518396160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572287.599783:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572287.599848:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572287.599854:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518396544:0@lo:400:kworker.0 00000100:00100000:3.0:1788572287.599891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572287.599917:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf634c0e-dd8a-4982-ad2a-0f984621b961:3299:1875453518396288:0@lo:400:kworker.0 00000100:00100000:3.0:1788572287.602597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572287.602655:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572287.602666:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518396416:0@lo:400:kworker.0 00000100:00100000:3.0:1788572287.602696:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572287.602800:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518396288 00000100:00100000:3.0:1788572287.602808:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518396288 00000100:00100000:3.0:1788572287.602848:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788572287.602857:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c076490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3299:x1875453518396288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572287.602902:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c076490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf634c0e-dd8a-4982-ad2a-0f984621b961+19:3299:x1875453518396288:12345-0@lo:400:kworker.0 Request processed in 46us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572287.602909:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788572287.603314:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf634c0e-dd8a-4982-ad2a-0f984621b961:3299:1875453518396288:0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604051:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518396160 00000100:00100000:2.0:1788572287.604069:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518396160 00000100:00100000:2.0:1788572287.604109:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788572287.604116:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518396160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572287.604146:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788572287.604205:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518396160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.604221:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788572287.604243:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518396544 00000100:00100000:2.0:1788572287.604262:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518396544 00000100:00100000:2.0:1788572287.604283:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518396416 00000100:00100000:2.0:1788572287.604286:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518396416 00000100:00100000:2.0:1788572287.604302:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788572287.604307:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518396544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604337:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1875453518396544:12345-0@lo:400:kworker.0 Request processed in 30us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.604343:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788572287.604353:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572287.604358:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c0764a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518396416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604384:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c0764a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1875453518396416:12345-0@lo:400:kworker.0 Request processed in 26us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.604389:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572287.604424:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518396544:0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604438:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c0764a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1875453518396160:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572287.604458:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572287.604493:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1875453518396416:0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604540:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518396672:0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604578:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572287.604626:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518396800:0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604646:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572287.604676:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572287.604681:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88c049806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518396928:0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604700:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572287.604719:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518396672 00000100:00100000:2.0:1788572287.604722:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518396672 00000100:00100000:2.0:1788572287.604745:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518396800 00000100:00100000:2.0:1788572287.604747:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518396800 00000100:00100000:2.0:1788572287.604760:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875453518396928 00000100:00100000:2.0:1788572287.604762:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875453518396928 00000100:00100000:2.0:1788572287.604774:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788572287.604779:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518396672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604808:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875453518396672:12345-0@lo:400:kworker.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.604815:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788572287.604825:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788572287.604830:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518396800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604853:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875453518396800:12345-0@lo:400:kworker.0 Request processed in 23us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.604859:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788572287.604867:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788572287.604872:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88c049806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518396928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.604892:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88c049806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875453518396928:12345-0@lo:400:kworker.0 Request processed in 20us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572287.604906:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788572287.604920:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572287.606135:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875453518396672:0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.606165:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1875453518396928:0@lo:400:kworker.0 00000100:00100000:2.0:1788572287.606186:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88c049805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1875453518396800:0@lo:400:kworker.0 00010000:00010000:3.0:1788572287.658233:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788572287.675682:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1788572287.675698:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1788572287.675704:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed Debug log: 30050 lines, 30050 kept, 0 dropped, 0 bad.